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AN EXPERIMENT WITH LISPERS 


CHARLES SCOTT BERRY 


Professor of Educational Psychology, University of Michigan, and Con- 
sultant in Special Education, Detroit Public Schools 


AND 
CLARA B. STODDARD 


Supervisor of Speech Improvement, Detroit Public Schools 


This experiment was undertaken to determine to what extent 
lispers who receive no corrective speech training improve as 
compared with those who receive such training. 

During the last of September and first of October 448 lispers 
in the regular grades of the Detroit public schools were tested 
by 28 speech improvement teachers. The lispers in grades one, 
two and three were given the Detroit Articulation Test I, 
Reading Form; and those in grades seven to twelve, the Detroit 
Articulation Tests II and IIT." 

After the lispers had been tested they were paired as far as 
possible according to school, grade, extent of defect, intelli- 
gence, age and home language. From the middle of October 
to the first of June one member of each of the 224 pairs of 
lispers was given two lessons per week of 75 minutes duration 
in the regular speech improvement classes. The other member 
of each pair received no corrective speech training. The 
lispers who received the lessons in speech improvement are 
known as the “experimental group,” and those who received no 
lessons in speech training as the ‘‘control group.” In June the 
members of both the experimental and the control groups were 
retested by the same speech improvement teachers who tested 
them in the fall. In fact, this experiment consisted of twenty- 
eight independent experiments, as each one of the twenty-eight 


1 These tests are published by the Detroit Board of Education. 
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teachers selected and tested sixteen lispers, paired them, taught 
her own experimental group in her own speech improvement 
classes and in June retested lier own experimental and control 
groups. 

TABLE 1 


Comparison of the experimental and control groups in respect to extent of 
defect, grade distribution, intelligence, age, home language and sex 





EXPERIMENTAL CONTROL 








GROUP GROUP 

IE A as ine ea ei ee ois ee 172 172 
Extent of defect: 

pi PTET TEES PETS Lee 55.2 55.7 

eo oa eee uk sind 56.0 56.5 

EN shad. os cu zctcahnere sean etn 49.5 51.0 

Wer ES vo. dios whos Ccdsueedeves 62.0 62.0 

Quartile Deviation........................ 6.2 5.5 

per cent per cent 

Grade Distribution: 

Re sista dss aah es a deed coins die 70.5 70.5 

cad ou dos a dweded bs tndds diene se 27.1 27.1 

ELE LOGE ae Se ee 2.4 2.4 
Intelligence 

Pes Salve nis Rd vhkaaodinesun-ae easiest tee 11.0 10.5 

Meise cb cep weds Cane cts bis adpuetesbaaties 55.8 59.3 

WS ie SaR esa sivas dekake &- » hd WHER eaten 33.2 30.2 
Age: 

eR ERs a oll all on oe hn oe enh 43.6 45.9 

i in ea vvinme ane heh euae thee nekxee 56.4 54.1 
Home Language: 

ET VUL Leh od.e ccebeveva Juanes NG 56.4 58.1 

Nadi sie. ENR a aes dR ROARED o Cuhe 43.6 41.9 
Sex: 

TN i a a FS i iia ole Ud ht i dle eae os 65.7 60.5 

Mirdiecassvahde 4uciiaasd.so aaah chee eens 34.3 39.5 











Of the 224 pairs of lispers with whom the 28 teachers started 
in October there remained in June 172 pairs for whom complete 
data were available. Only the results for these 172 pairs are 
presented in the following tables. 

In table 1 the experimental and control groups are compared 
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in respect to extent of defect, grade distribution, intelligence, 
age, home language, and sex. 

In the articulation tests used to determine the extent of 
defect, the possible scores range from 100 to zero, 100 repre- 
senting speech free from errors of voice and articulation. In 
these tests the score is determined by subtracting the number 
of errors from 100. In table 1 the extent of defect is repre- 
sented by the scores made in the articulation test given at the 
beginning of the experiment. Not only are the experimental 
and control groups closely similar in average and median scores 
but also in variability as expressed by the quartile deviation. 

In the Detroit Public Schools pupils are classified by in- 
telligence tests into three groups known as X, Y, and Z. In 
the X group are found the 20 per cent that test highest in a 
given age group; the next 60 per cent make up the Y group 
and the lowest 20 per cent comprise the Z group. From table 1 
it is evident that there is no great difference between the 
experimental and control groups in respect to intelligence. 
Neither is there any significant difference between the two 
groups in respect to grade distribution, age, and language spoken 
at home. The greatest difference is in the distribution of boys 
and girls, there being only 34 per cent of girls in the experimental 
group as compared with 39 per cent in the control group. 
However, this proved to be to the advantage of the control 
group as the girls were found to make a slightly greater gain 
than the boys. 

In table 2 the facts relative to the improvement made by the 
experimental and control groups from October to June are 
presented. 

The improvement in speech in these 172 pairs of lispers was 
determined by subtracting algebraically the October score in 
the articulation test from the June score in the same test. The 
remainder thus obtained represented the difference in the num- 
ber of errors made in the two tests. Thus gain or improvement 
is measured by the decrease in the number of errors. In table 
2 the average improvement for the experimental group is seen 
to be 27.5 as compared with 4.3 for the control group. This 
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means that the experimental group averaged 27.5 less errors in 
the second test than in the first and that the control group 
averaged 4.3 less errors in the second test than in the first. 
The median improvement of the experimental group is 27 
points greater than that of the control group. The marked 
variability of improvement in the middle 50 per cent of the 
experimental group is indicated by the large quartile deviation 
of 10.2. 

Some significant facts not presented in this table are that only 
1.7 per cent of the experimental group failed to gain while 
45.3 per cent of the control group made no gain, that only 2.3 
per cent of the control group reached or exceeded the median 


TABLE 2 


Improvement in experimental and control groups 














EXPERIMENTAL GROUP CONTROL GROUP 

2| 2 > 2\2 > 

4 2/2/)4 so 2/214 
PiS\El El | slFlslelei2| 
ei) Bile) & 3 | sia) e 3 : 
aliziznielSlelelsiaielsi 2 
Improvement. ........ 27.5) 29) 17|37.5)10.2) —6|4.3) 2 | 0.| 7 |3.5)—22 
to to 
73 46 









































improvement (29) of the experimental group, and that only 6.4 
per cent of the control group exceeded the 25 percentile point 
of the experimental group. Furthermore, only 1.7 per cent 
of the control group made a score of 85 or above in the June 
articulation test as compared with 54.6 per cent of the experi- 
mental group. This is especially significant since pupils are 
usually discharged from the speech improvement classes on 
trial who make a score of 85 or above. In other words, more 
than half of the pupils in the experimental group were ten- 
tatively discharged from the speech improvement classes as no 
longer in need of special corrective treatment as compared with 
1.7 per cent in the control group. In this connection it might 
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be said that the amount of improvement made by the experi- 
mental group was about the same as that made in the regular 
speech improvement classes during the previous year. 

In connection with an experiment of this kind the question 
arises as to the extent to which factors other than corrective 
speech training may condition improvement. For example, 
what may be the effect of extent of defect, intelligence, age and 
home language on speech improvement? 

In table 3 the 172 pairs of lispers in the experimental and 
control groups are classified according to extent of defect. 























TABLE 3 
Improvement in relation io extent of defect 
EXPERIMENTAL GROUP CONTROL GROUP 
s e|e| r) eolels 
EXTENT OF |S -lsi/3)28 6 :|3/312 
DEFECT 4 -1S/B/ 8/81, 12 ; | S21e/6 
ag a; SlSielE| gaa 8g] fist El 213 
58] 5 \gl2/2/ 4 led 2] 2 lsiélé 
2 |e <q /a2;/R8/ 828 | oi | & <|/2/R8/8\|¢ 
Class I 43) 25.0|35.3} 36) 23/44 [10.5] 35) 20.4)10.0) 7 | 0 |14 |7.0 
49 or less 
Class II 67| 39.0/29.3) 33) 2038 | 9.0) 66) 38.4) 3.6) 1 | 0 | 5 |2.5 
50 to 59 
Class III 62| 36.0/20.2) 20) 10/30 (10.0) 71) 41.2) 2.110) 0) 5 |2.5 
60 or more 
Totals... . .|172|100.0)/27 .5| 29) 17/37 .5|10.2}172/100.0) 4.3) 2| 0 | 7 |3.5 















































In Class I are those who made a score of 49 or less in the 
October test; in Class II, those who made a score from 50 to 
59; and in Class III, those whose score was 60 or above. By 
referring to this table it is seen that there is a marked cor- 
relation between extent of defect and amount of improvement, 
the greater the extent of defect the greater the improvement. 
For Classes I, II, and III the median improvement is respec- 
tively 36, 33 and 20 in the experimental group, and 7, 1, and 0 
in the control group. The same order of improvement is 
maintained in the 25 and 75 percentiles of all three classes in the 
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experimental group. However, in both the experimental and 
the control groups the three classes overlap to a marked degree 
in the amount of improvement. 

The significant fact revealed by this table is the marked 
positive correlation between extent of defect and amount of 
improvement. 

In table 4 the lispers are classified according to intelligence. 
This table shows that in both the experimental and control 
groups the lispers of Y intelligence made a greater median and 
average gain than those of Z or X intelligence. However, the 
greater gain made by the Y lispers might be due to there being 


TABLE 4 
Improvement in relation to intelligence 























EXPERIMENTAL GROUP CONTROL GROUP 
Fs elelth {2 elel|s 
INTELLIGENCE | © ~ é a = 2 a |° ~ 4 rt = =z a 
Ze) 22) 2) £|/8] 2 | 2 |¥s| 82/8/45) 2) 2/2 
gH els le lel 2| a led bole le le] i 
Z| es “<;/2/8/8 | COAliae |4/a2/R8/F 1 Co 
xX 19} 11.1/26.2)28 | 11/39 |14 | 18) 10.5/2.80 | 0/0 \0 
Y 96) 55.8|29.5)31.5) 19|39 (10 |102) 59.3)4.6/2 | 0) 8 |4 
Z 57| 33.1/24.8/24 | 16/35 | 9.5) 52] 30.2)4.3)1.5) 0 | 6 (3 
Totals... . .|172|100.0/27.5/29 | 17/37.5|10.2/172/100.0)4.3/2 | 0 | 7 |3.5 















































in that group a larger percentage of cases in Class I than in the 
groups of X or Z intelligence, for we have seen that there is a 
positive correlation between extent of defect and amount of 
gain. 

In table 5 the lispers of X, Y and Z intelligence are divided 
according to extent of defect into ClassesI,II,and III. From 
this table it can be seen that in the experimental group the 
Y’s have a larger percentage of cases in Class I than have the 
Z’s; but this is compensated for by the larger percentage of 
Y’s in Class III. Furthermore, when we compare the median 
and average improvement of the Y pupils in Classes I, II, and 
III with the Z pupils in the corresponding classes we find that 
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in each class the Y pupils made a greater average and median 
improvement than the Z pupils. 

The Y’s have a larger percentage of cases in Class I, but a 
smaller percentage in Class III than have the X’s. If the dis- 
tribution of X and Y pupils into Classes I, II, and III were the 


























TABLE 5 
Improvement in relation to intelligence in lispers similar in extent of defect 
EXTENT OF DEFECT 
Experimental group Control group 
INTELLIGENCE 
OT a | ee 
49 or| 50 to] 60 or| ~°%#8| 49 oF| 50 to | 60 or | Totals 
less | 59 |more less | 59 | more 
ee 317 19 19 | 3 6 9 18 
Percent...........|16 |37 |47 |100 {17 | 33 | 50 {100 
ee re 47 .3|24.5|20.4| 26.2|20.5|—0.7|—0.9} 2.8 
Med. Imp........./52 |23 |25 | 28 /15 0 0 0 
Number.........../29 |31 |36 | 96 |22 | 33 | 47 |102 
Y Per cont........... 30 |32 |38 {100 |22 | 32 | 46 /100 
a eee 35 .8)/33.4/21.1) 29.5)10.6| 2.6) 3.0) 4.6 
eS ee 39 |35 |22.5) 31.5)10 1 2 2 
{Number...........|11 |29 |17 | 57 [10 | 27 | 15 | 52 
z ten ie CU 19 {51 |30 {100 |19 | 52 | 29 /|100 
Rae 309/26 .0)18.8) 24.8) 5.4) 5.4) 1.5) 4.3 
(Med. Imp........./30 |[30]|19 |24 |25| 4 | 0 | 1.5 
Number........... 43 (67 (62 |172 (35 | 66 | 71 {172 
Totals re 25 |39 |36 |100 |20 | 39 | 41 /|100 
Pr TR. ik 35.3/29.3/20.2| 27.5|10.0} 3.6} 2.1] 4.3 
|Med. Imp......... 36 |33 20 |20 |7 | 1 | 0 | 2 





























same as in the entire experimental group, the average improve- 
ment of the X group would be approximately the same as that 
of the Y group. 

In the control group we have little evidence of any significant 
relation between improvement and intelligence. 

However, the facts presented in table 5 show that on the 
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average Z lispers make less progress in speech improvement 
classes than the lispers of higher intelligence. 

In table 6 the lispers are divided into two groups according 
to age at last birthday. In one group are those 5, 6, or 7 
years of age; in the other, those 8,9, 10 or above. By reference 
to this table it can be seen that in the experimental group the 
median improvement of the younger pupils is 3 points higher 
than that of the older pupils. However, if the percentage dis- 
tribution of the age groups in respect to extent of defect and 


TABLE 6 
Improvement in relation to age 





EXPERIMENTAL CONTROL 
GROUP GROUP 





Age 
5, 6,7 or more 5, 6,7 





Number of cases 75 79 
Extent of defect: 
Per cent Class I—49 or less 29 23 
Per cent Class II—50 to 59 35 38 
39 


Per cent Class III—60 or more 36 
Intelligence: 
Per cent X’s 13 
Per cent Y’s 69 
Per cent Z’s 18 





Med. improvement 40) 0.0 
Av. improvement ; 6.6 | 2.4 

















intelligence were the same it would reduce this difference from 
3 points to about 2. Also in the control group, if the percentage 
distribution of both age groups were the same in respect to 
extent of defect and intelligence, the difference in the median 
improvement of the two age groups would be slightly less. 

If the percentage distribution were equalized as suggested 
still the median improvement of the younger children in both 
experimental and control groups would be greater than that ef 
the older children, but not enough greater in view of the wide 
variability, to have much significance. 
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In table 7 the lispers are divided according to home language. 
In the “English” group are those who heard only English 
spoken at home, while in the “foreign” group are those who 
heard only a foreign language or a foreign language and English 
spoken at home. 

It can be seen from this table that in both the experimental 
and control groups the lispers who heard only English at home 
made a greater median and average improvement than those 
who heard a foreign language at home. However, if the per- 


TABLE 7 
Improvement in relation to home language 





HOME LANGUAGE 





Experimental Control 
group group 





English|Foreign|English| Foreign 





Number of cases 97 75 100 72 
Extent of defect: 
Per cent Class I—49 or less 26 17 
Per cent Class II—50 to 59 37 37 
Per cent Class III—60 or more 37 46 
Intelligence: 
Per cent X’s 16 13 
Per cent Y’s 59 64 
Per cent Z’s 25 23 


.| 31 2.0 
28.8 : 4.4 





Improvement 

















centage distribution in respect to degree of defect and intelli- 
gence were the same for the two language groups, the difference 
in the average improvement would be decreased in the experi- 
mental group, but increased in the control group. But in 
neither case would the change amount to as much as one point. 

The data presented in this table seem to show, other things 
being equal, that lispers who heard only English spoken at home 
made a slightly greater improvement than those who heard 
a foreign language at home. 
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The data for lispers tabulated separately for boys and girls 
showed no marked sex differences in the amount of improve- 
ment, although the girls made a slightly greater gain than the 
boys. 

In this experiment speech improvement in lispers of the like 
extent of defect was found to be conditioned only to a slight 
extent by differences in intelligence, age, home language or sex 


as compared with corrective training in speech improvement 
classes. 


SUMMARY AND CONCLUSIONS 


In September and October 344 lispers in the public schools 
of Detroit were given speech tests and then paired in respect to 
school, grade, extent of defect, intelligence and home language. 

One hundred seventy-two of these lispers, the experimental 
group, were given two lessons per week in the regular speech 
improvement classes. The remaining 172 lispers, the control 
group, received no lessons in corrective speech training. 

In June both groups were again given speech tests. The 
change in speech was measured by the difference in the scores 
made in the two tests. The score was determined by sub- 
tracting the number of errors made in the test from one hun- 
dred. Thus improvement was measured by decrease in number 
of errors. 

The median improvement for the experimental and control 
groups was respectively 29 and 2. Only 1.7 per cent of 
the experimental group failed to gain; but 45.3 per cent of 
the control group made no gain. Only 2.3 per cent of the con- 
trol group reached or exceeded the median improvement of the 
experimental group. 

In both the experimental and control groups positive cor- 
relation was found between extent of defect and amount of 
improvement. 

The lispers of low intelligence made a smaller average im- 
provement than those of higher intelligence. 

In both the experimental and the control groups the lispers 
from homes where a foreign language was spoken made a smaller 
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average gain than those from homes where only English was 
spoken. 

The girls made a slightly greater average improvement than 
the boys, but not enough greater to be significant. 

In this experiment speech improvement in lispers of like 
extent of defect was found to be conditioned only to a slight 
degree by differences in intelligence, age, home language or sex, 
as compared with corrective training in speech improvement 
classes. 





CHALLENGING THREE STANDARDIZED EMOTIONAL 
TESTS FOR VALIDITY AND EMPLOYABILITY 


DONALD R. GORHAM 


Eastern University 
AND 
R. A. BROTEMARKLE 


University of Pennsylvania 


Three tests stand out as conspicuous attempts to analyze 
the complex emotional makeup of the individual. These are 
the Downey Will-Temperament Test, the Pressey Cross-Out 
Tests, and the Brotemarkle Comparison Tests. Much of the 
criticism of these tests is due to a lack of understanding of their 
proper use. The fault lies partly at the door of the authors 
of the tests. Although Downey has set forth at some length 
an account of the construction and use of her test,' neither 
Pressey nor Brotemarkle has written a sufficient explanation of 
his tests to make them employable by any except experienced 
clinical psychologists. The result is that the tests have been 
misused and the results misinterpreted. In this study these 
tests are challenged as to their validity and employability, 
and the challenge is accepted with an attempt at vindication. 

The method has been two-fold: first, to determine the 
validity of the tests by statistical comparison of the various 
scores; second, to determine their validity by using them as the 
basis of case studies. 

The data were secured from the members of a seminar class 
at Eastern University—ten men and ten women, most of whom 
were college freshmen. In the case of the self-ratings and 
composite ratings on the Downey Will-Temperament Test, 
only ten students participated—the ones who were best fitted 
to rate one another. 


1 Downey: The Will-Temperament and Its Testing. 
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THREE STANDARDIZED EMOTIONAL TESTS 


I. STATISTICAL COMPARISON 


The Downey Will-Temperament Test 


Procedure. Two types of ratings of the Will-Temperament 
Test were employed. The first type was secured in the usual 
way—by administering the Downey Group Will-Temperament 
Test. The second type was made up of the judgments of the 
individuals by themselves and others of the group. The group 


TABLE 1 
Correlations between Test Ratings, Self Ratings and Composite Ratings of 
Downey Will-Temperament Traits 





TS* TC Cs 
WILL-TEMPERAMENT TRAITS 





r P.E. P.E. P.E. 


. Speed of Movement 67.1 .12 ; 10; .£ 15 
. Freedom from Load .18 | .19 ; 21}. 14 
. Flexibility 18) DD . .09 
. Speed of Decision yi i 3 12 
. Motor Impulsion 04} .21 14 
Reaction to Contradiction....| .42 | .17 : 21 
. Resistance to Opposition. ....} .03 | .21 17 
. Finality of Judgment .08 | .21 17 

Motor Inhibition 61] .15 . Bt 

Interest in Detail.............| .49 | .17 .47 | .19 
. Co-ordination of Impulses....| .30| .19| .56/| .14 
. Volitional Perseveration ....| . 21 .06 | .21 


.249) .18 .247| .19 





A 
B 

Cc 
D 
E 
F. 
G 
H 
I. 

J. 
K 
L 





























*T = Test Ratings; S = Self Ratings; C = Composite Ratings. 


supplying these ratings consisted of ten students, mostly college 
freshmen. The author’s definition of the Will-Temperament 
traits was used as the basis for the judgments. The composite 
rating of each student was secured by averaging the ratings of 
the other nine members of the group. 

Results. The coefficients of correlation between the test, 
composite and self-ratings and the twelve Will-Temperament 
traits are shown in table 1. The data show that the average 
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correlation of both self and composite ratings with the test 
ratings was almost identical, the coefficient being about .25 
+.18. In regard to certain traits, there seemed a marked 
ability to judge on the part of the students, viz.: 


PRU PIII 5 ku 5 en athe do ones eed be becdbeide 715 
Ee NN i ns oo ok. sins adcaw dupepwes walk .70 
EET EEE Slt Se ee ee een en 48 
EY Niet Seas tcc c00sc hcp rarncvass vss hedus 465 
ION He III 68 66 Siw in cca cctdevensdedas 43 


In regard to flexibility, there was not a consistent judgment, 
the composite ratings giving a very high coefficient, while the 
self ratings gave a negative coefficient—when correlated with 
the test scores. 

In certain traits the students showed a marked agreement 
among themselves as to the amount possessed by themselves 
and others. This is shown by the CS coefficients in table 1. 
In the following traits, marked agreement in rating was 
manifest: 


ee ee as sain Wome kage hte ome 81 
I IN oi Ss wow bibl ethsinte Rinse So Ws atin 75 
se AE cody + sbadeaeresdertnabes 71 
NN iis on acc cic cdosestsecmeds oncme .61 
oO eee ID, i As 6 eenmawseue Gakeas'enavn .60 
eT ee a... caeeeepowulyne's «wens .60 
Pemmathan to Coomirneietaee so. oj. cc cme cc ccc cee .59 
ee ee ee re .52 
PS Ae .48 


It appears, then, that in at least three-fourths of the traits 
the students evidently understood the definitions of the traits 
and were able to rate themselves and others on the degree to 
which they were possessed. Unfortunately, although they 
agreed among themselves, their ratings on the majority of these 
tests did not agree with the rating as measured by the test. 
Whatever the Downey test measures, we must conclude that 
it does not measure what this group of students observe as 
they understand the definitions of its component factors. 
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The Pressey Cross-Out Tests 


Procedure. The Pressey Cross-Out Tests were given to the 
group. Differential scores for men and women were com- 
puted as follows: The forty words of the entire test were found 
which were crossed out most often by the women; also the 
analagous forty words crossed out most often by the men. The 
rating of each case equals the number crossed out of the women’s 
words, less the number crossed out of the men’s words. The 
results are shown graphically in chart 1. The striking sex 
difference as shown by words crossed out on the test is immedi- 
ately apparent. When it is remembered that the words crossed 
out—if analyzed—furnish an index to the emotional life of 
the individual, these results become truly significant.” 

Test 1 of the Pressey Cross-Out Test was analyzed for each 
case by determining the number of each type of words crossed 
out, viz., disgust, fear, sex, suspicion, and the jokers. Table 2 
gives the results for each case, together with the means for 
men arid women, and the tentative norms given by Pressey. 
Chart 2 shows the averages for men and women compared with 
the norms. Although the chart serves to compare the averages ° 
with the norms, it must be admitted that the comparisons are 
not significant, since one abnormal score in the group would be 
completely obliterated by the whole. 

The same procedure was followed for Test 4, and the data are 
presented similarly in table 3 and chart 3. 


The Brotemarkle Comparison Test 


Procedure and results. The Brotemarkle Comparison Test 
was given to the group and the data are shown in table 4, 
expressed by the total deviation. 


Five Test Scores Compared 


After the foregoing examination of each test individually, 
the five sets of test scores were thrown together for the purpose 
of comparison. The data are presented in table 5. After all, 


* Journal of Applied Psychology for April, 1921. 
























558 DONALD R. GORHAM AND R. A. BROTEMARKLE 


now that we have the scores for the twenty cases, what do they 
mean? Is Downey justified in stating in her Test Manual that 





Differential Score 
24 -12 -10 -8 6 -4 <2 2 4 6 0: 1-48. 44 

























































































——$=$ Women aa Men 


Computed as follows: The forty words of the entire test were 
found which were crogsed out most often by the women; also the 
forty words crossed out most often by the men. The rating of 
each subject equals the total crossed out, of the women's words, 
less the total crossed of the men's words. 











Cuart 1. DirreERENTIAL Score ON Pressey X-O TEst 


a high total score on her test indicates a strong personality 
while a low total score represents a weak personality? If so, 
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TABLE 2 


Analysis of Test I—Pressey X-O Test 















































CASE NUMBER | DISGUST | FEAR | SEX SUSPICION JOK ERS TOTAL 
Women 

4 19 12 10 14 55 

7 20 S 18 Ss 54 

‘ 14 3 10 4 30 

10 7 2 10 6 25 

12 12 15 8 9 44 

13 15 10 10 12 47 

15 14 10 9 16 49 

16 10 2 s 13 33 

17 15 13 7 15 50 

20 18 1l 10 15 54 
Mean.....| 14.4 8.5 10.0 11.2 44.1 

Men 

1 16 3 3 5 27 

2 21 9 11 4 45 

3 14 12 9 15 50 

5 11 Zz 8 8 34 

6 16 10 12 13 51 

9 8 3 } 5 17 

11 8 5 3 2 18 

14 18 16 11 18 63 

18 13 7 6 10 36 

19 16 5 8 2 31 
Mean..... 14.1 Pes 7.2 8.2 37.2 

Total 

Mean...| 14.25 8.1 8.6 9.7 40.6 
Norm..... 14.2 8.6 13.0 10.1 3 46.2 























Tentative norms given by Pressey in Journal of Abnormal Psychology 
for April, 1921. 

Each column gives the words crossed out by each case with the 
averages for men and women, the total cases, and the Pressey norms. 











560 DONALD R. GORHAM AND R. A. BROTEMARKLE 








Average mwaber of words crossed out 


3 4 5 6 7 8 D. @a  ceee O  o 
Disgus* eel 
& tp Gippp2 no EE tee ee QZALZ: 
Fear 
Sex 
Suspicion 
Jokers 























GH Pressey Norns 


Averages for ten women end ten men es compared with 
the Pressey norms (114 college students - 56 women & 
56 men). 








Analysis of Test I, Pressey X-0 test. 








Cuart 2. ANaLysis OF Test I—Pressey X-O Test 





Averege number of words crossed out 


4 S 6 7 8 > ee 2a: & 


Paranoid 


Neurotic 








2 77222 (tt 2 ttt." t722: 








ia 





Shut-in Personelity 








Melancholic 


Hyperchondriecal 

















GHEE Pressey Norms Anslysis of Test IV, Pressey X-0 Test. 





(QE Women Averages are for ten men and ten women as compare’ 
sen witb the Pressey norms (114 men end women). 











Cuart 3. ANaLysis or Test I[V—Pressey X-O Test 
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TABLE 3 
Analysis of Test 1V—Pressey X-O Test 





MELAN- 


CASE NUMBER CHOLIC 





PARANOID 





NEUROTIC SHUT-IN 





HYPERCHON TOTAL 





















































Women 
4 10 6 14 7 45 
7 1 2 1 3 0 7 
8 6 4 15 12 12 49 
10 2 3 2 4 0 11 
12 7 6 6 10 
13 7 12 1l 12 13 55 
15 13 8 11 13 s 53 
16 6 4 7 3 27 
17 8 3 7 16 \ 42 
20 4 14 7 7 3 35 
Mean..... 6.4 6.2 7.7 9.4 6.4 36.1 
Men 
1 16 9 12 15 10 62 
2 3 0 3 2 1 9 
3 9 7 7 11 3 37 
5 3 s 6 3 8 28 
6 1 5 0 1 2 9 
9 4 7 2 8 8 29 
11 4 5 6 11 7 33 
14 10 13 15 13 3 54 
18 10 6 11  f 2 36 
19 8 8 5 13 16 50 
Mean.... 6.8 6.8 6.7 8.4 6.0 34.7 
Total 
Mean... 6.6 6.5 ee 8.9 6.2 35.4 
Norm..... 9.3 9.6 9.7 11.1 9.8 49.5 























Tentative norms given by Pressey in Journal of Abnormal Psychology 
for April, 1921. 

Each column gives the words crossed out by each case with the 
averages for men and women, the total cases, and the Pressey norms. 
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Deviation on Brotemarkle Comparison Test 


TABLE 4 





| 
CASE NUMBER I 
| | 



























































Ir | Itt | IV | Vv | vi | vir | TOTAL 
Women 
4 . 4 oor s |2is |2 | 2 
7 2 4 4 2 0 4 12 28 
8 0 2 6 10 2 6 4 30 
10 2 6 4 2 2 8 14 38 
12 6 4 4 6 6 8 6 40 
13 2 10 2 0 0 0 4 18 
15 4 6 0 4 0 4 0 18 
16 4 6 2 2 6 2 0 22 
17 2 2 4 10 2 6 12 38 
20 0 4 0 4 0 4 2 14 
Mean.....| 2.4 46} 3.0 48} 2.0|] 5.0| 5.6} 27.4 
Men 
1 4 2 2 8 4 4 4 28 
2 0 4 8 6 0 6 6 30 
3 + 4 8 2 2 6 4 30 
5 2 2 0 4 0 6 4 18 
6 0 4 2 8 0 6 0 20 
9 0 0 2 2 2 4 8 18 
11 4 2 2 4 4 2 4 22 
14 0 4 6 4 6 8 2 30 
18 4 4 0 14 2 4 4 32 
19 2 6 2 0 4 2 2 18 
Mean. 2.0 3.2} 3.2 §.2) 2.4) 4.8] 3.8 | 24.6 
Total 
Mean...| 2.2 3.9} 3.1 5.0} 2.2| 4.9| 4.7] 26.0 
Norm..... 3.0 4.1] 3.1 44) 3.4] 45] 3.3] 24.0 
I Basic Moral Principle 
II Reactive Profile 
III Emotional Response 
IV Expressive-Regressive Attitude 
V_ Relational Adjustment 
VI Underlying Feeling-Emotive 
VII Resultant Orientation 
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TABLE 5 
Five test scores 
CASE | a’ | I | Q | T | 7) TOTAL 
Women 
4 235 38 108 57 28 466 
fl 159 39 126 : 78 28 430 
8 206 43 114 75 30 468 
10 87 41 114 73 38 353 
12 185 58 115 66 40 464 
13 209 41 114 61 18 443 
15 227 61 118 72 18 496 
16 155 41 109 74 22 401 
17 216 37 111 81 38 483 
20 196 49 118 60 14 437 
Mean.....| 187.5 44.8 114.7 69.7 27.4 454.1 
Men 
1 191 49 117 60 28 445 
2 142 54 107 73 30 406 
3 204 40 113 72 30 469 
5 154 39 115 76 18 402 
6 175 50 111 84 20 440 
9 131 45 110 62 18 366 
11 134 42 120 73 22 391 
14 293 40 121 60 30 544 
18 193 48 122 73 32 468 
19 227 47 112 68 18 472 
Mean.....| 184.4 45.4 114.8 70.1 24.6 440.3 
Total 
Mean...| 185.9 45.1 114.7 69.9 26.0 447 .2 
Median...| 230 47.2 109 24.0 


























*A—“Total Affectivity’’ score on Pressey X-O Test. 
I—‘‘Total Idiosyncrasy’’ score on Pressey X-O Test. 
Q—IQ as determined by the Otis Scale. 

T—Total score on Downey Will-Temperament Test. 
B—Total ‘‘deviation’’ on Brotemarkle Comparison Test. 
Medians as given by the authors of the tests. 
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why is it that no significant correlations are found between her 
total scores and those of the other tests? (See table 6.) The 
same question might be asked concerning the other test. 

The lack of correlation between the five sets of test scores 
is rather striking. One of two conclusions is possible: either 
the tests are not all that their authors claim them to be, or else 
the method of checking their validity was at fault. 

It should be said that the authors of all three tests admit that 
the total scores are not the important data to be secured by 


TABLE 6 
Correlations of five test scores 








P.E. 
T Bt 173 15 
A I .008 15 
A Q 135 14 
AT — 341 13 
A B — .031 15 
Q I .007 15 
T I — 051 15 
BI .088 14 
QT .008 15 
Q B 019 15 











*A—‘‘Total Affectivity’’ score on Pressey X-O Test. 
I—‘‘Total Idiosyncrasy’’ score on Pressey X-O Test. 
Q—IQ as determined by Otis Secale. 

T—Total score on Downey Will-Temperament Test. 
B—Total “‘deviation’’ on Brotemarkle Comparison Test. 


their tests. Downey urges the study of the Will-Temperament 
profile and points out the fact that the total score may be mis- 
leading. Pressey, although he gives tentative norms for total 
scores, points to the much greater value of analysis of each 
individual test. Brotemarkle admits that a total deviation 
score on his test is practically valueless unless the deviation on 
each of the seven series of the test is known.‘ 


* Journal of Abnormal Psychology, April, 1921. 
‘ Journal of Applied Psychology, February, 1928. 
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If the method used is valid, we should feel justified in making 
a rather harsh criticism of the tests. Before doing this, how- 
ever, it seems only fair to give the suggestions of the authors a 
fair trial and actually use the analytical method of comparison 
foreach case. With this thought in mind, the foregoing results 
were taken to the author nearest at hand, namely, Prof. R. A. 
Brotemarkle of the University of Pennsylvania. He accepted 
the challenge for the group, and suggested that the case-study 
method be applied to the same data in order to see whether it 
too failed to disclose significant results. The remainder of 
this study is the result of carrying out this suggestion. 


Il. THE CASE-STUDY APPROACH 
Procedure 


At the suggestion of Prof. Brotemarkle the data for each 
individual student was set out in the form of profiles and scores, 
making a case chart. Using these charts as a sole source of 
information he analyzed each case. To check the validity of 
this clinical analysis two other statements were secured concern- 
ing each case from men who had known the students for a 
period of one school year. Analysis I was from an instructor 
associated with the students in the classroom and in activities. 
Analysis II was by the dean of the school, whose contacts with 
the students had been in his official capacity. 

In order to further check the validity and employability of 
the tests the authors of the other two tests were extended the 
invitation to make an analysis on the basis of the case charts. 

Professor Downey replied, ‘‘I do not like to risk a chance on 
personality reading on the basis of the Will-Temperament 
Profile taken by itself.’’ 

Professor Pressey® suggested that the authors take the matter 
up with Prof. O. R. Chambers who, he felt, would be interested 
in attempting such an analysis. The latter, however, did not 
respond to the invitation.’ 

5 Letter of July 26, 1928. 


* Letter of August 1, 1928. 
’To date November 5, 1928. 
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Results 


KEY TO CASE CHARTS 


PressEY X-O Test Downey WILL-TEMPERAMENT 


Analysis of Test I PROFILE 
D—Disgust A—Speed of Movement 
F—Fear B—Freedom from Load 
S—Sex C—Flexibility 
S—Suspicion D—Speed of Decision 
J—Jokers E—Motor Impulsion 


F—Reaction to Contradiction 


Analysis of Test IV G—Resistance to Opposition 


P—Paranoid H—Finality of Judgment 
N—Neurotic I—Motor Inhibition 
S—Shut-in J—Interest in Detail 
M—Melancholic K—Co-ordination of Impulses 
H—Hyperchondriacal L—Volitional Perseveration 


BROTEMARKLE COMPARISON TEST 
I Basic Moral Principle 


II Reactive Profile V_ Relational Adjustment 
III Emotional Response VI Underlying Feeling-Emotive 
IV Expressive-Regressive VII Resultant Orientation 
Attitude 


Observational Analysis I]. By an instructor associated with students 
for one school year in classroom and in activities. 

Observational Analysis II. By dean of school associated with stu- 
dents in that capacity for one school year. 

Clinical Analysis. By a psychological clinician, R. A. Brotemarkle, 
accepting the challenge for the authors of the three tests. His analysis 
was solely on basis of data given on the case charts. 

Student’s Reaction to Clinical Analysis. Obtained by personal 
interview with each student. 
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CasE 1 
CASE NO. 1 AGE19 SEXM_ 1017 AVERAGE GRADE_2.37 
_PRESSEY X-O° TEST SCORES 
Total Aff. Total Id._49 ede: ~~ eee 
Differential Score_-10 
Profile of Test I A > r 0 
aRRAALEDESOSS os canvaA) — 
¥ en B = oF 
s c 
mT D 
Y a 1 s | 
F _— 
Profile of Test IV G .~< ipa 
7 @ 4 ) ¥ 16] ase a 
N I = ™— = 
s S J T — 
M La K : T+ 
u i i L = ee 
BROTEMARKLE COMPARISON TEST TOTAL DEVIATION_28 
ee eS ws" 
194 0 a Vv - = - - - a a 
nIL 1 ee oe : : ; | i 
IV 2 Ko a ae a 2 a a me 








Observational Analysis I. An exceptional student, capable of doing 
an excellent grade of work. Reactions are slow. Probably a primary 
introvert. Violent temper although usually controlled; expressed by 
sulkiness. Well liked and very dependable. 

Observational Analysis II. A good student. Intelligent. Very 
sensitive. A good worker but slow in movement. A good reasoner. 
Dependable. 

Clinical Analysis. Poor Expressive-Regressive Attitude. Tem- 
perament factorshigh. Extreme attitude of disgust. Easily depressed 
and over-suspicious. Not aggressive. Apt to be personal in remarks— 
very biting on occasions but on others will shut up like a clam. 

Student’s Reaction to Clinical Analysis. A very good line-up of me. 
Have always been suspicious. Many people fill me with disgust by their 
manners, attitudes, etc. 
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CasE 2 





CASE WO. Z AGE 18 SEXM 1Q107 AVERAGE GRADE 1.44 





PRESSEY X-O TEST SCORES eueunemen 
Total Aff. 142 Total Id- 54 a 
Differential Score -10 























Aa 
D B 
F c 
5 D 
8 2 
z 7 
G 
P H 
N I 
© J 
M K 
H L 
BROTEMARKLE COMPARISON TEST TOTAL DEVIATION 30 
I Q Vv Q 
II + Ce ae VI ee oe ES 
IIE bended VII ae: ae SP | 
Iv * oS te Se 

















Observational Analysis I. Here is a changeable and explosive type. 
Never can be sure what he is going to do and are not surprised if he 
goes off the handle. Does average work, but at times shows ability to 
do high grade work. Would suspect there is some serious problem 
responsible for his general mal-adjustment, for he seems to have quali- 
fications of good personality. 

Observational Analysis II. A poor student. Slightly dull—may be 
due to habits. Somewhat sensitive. Poor in dependability. Slow in 
movement. 

Clinical Analysis. Good emotional balance. Exaggerated disgust. 
Activity low. Not in the least aggressive. Excellent control. Emo- 
tions not extreme. Can handle himself in any situation. A generally 
good type. 

Student’s Reaction to Clinical Analysis. No particular reaction. 
Accepted analysis. 
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Case 3 





CASE NO. 3 AGE 22 SEXM 1Q113 AVERACE GRADE 2.57 



































PRESSEY X-O TEST SCORES 
TEMPERAMENT 
Total Aff. 204 Total Id. 40 a se 
Differential Score 2 
Profile of Test I A 
D B 
y c 
Ss D 
8 E 
z F 
Profile of Test IV G 
P H 
N I 
s J 
M K 
Ez L 
BROTEMARKIE COMPARISON TEST TOTAL DEVIATION 30 
1 pee Vv : 
II eee Z vI ee Mn 
iil ; if i. } a VII | wa > a om 
IV | as 














Observational Analysis I. Seems to be a normal individual. Good 
intelligence and does very good work in studies. 

Observational Analysis IJ. A good student. Intelligent. Not very 
emotional. Dependable so far as I know. 

Clinical Analysis. Well balanced. Emotional factors are high. 
Slight tendencies towards melancholic and self-conscious reactions. 
Low in activity. Good adjustment and well-balanced. Not overtly 
active in adjustments which are largely internal. 

Student’s Reaction to Clinical Analysis. Student felt it was a fair and 
helpful analysis. Admits melancholic tendency which has been largely 
overcome. 
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CasE 4 





CASE NO. 4 AGE 24 SEX F 1Q 108 AVERAGE GRADE 2.85 
PRESSEY X-O TEST SCORES 
Total Aff. Total Id. 38 eee ~~ ree 
Differential Score 3 
Profile of Test I 





Profile of Test IV 


rRUuH tow Mv ow > 








Total Deviation 28 














Vv 
vi 
vi 


I 




















Observational Analysis I. This young lady has a very pleasing 
personality. Fits into the group well and is well liked. She is average 
as to mental activity. Seems to have plenty of assurance and purposive 
control. She has a cheerful disposition. It seems that she has times of 
depression, but her general air is that of one who takes life as it comes 
and does not worry. 

Observational Analysis II. A good student. Quick of movement 
and speech. Fair in intelligence. Emotional. Fairly trust-worthy. 
Unscientific in attitude. Credible. Inclined sometimes to depend on 
intuition and not to use reason. 

Clinical Analysis. Aggression very low. An overload of disgust 
with corresponding overload of hate. Emphatic melancholic type. 
Underlying feeling emotive low. 

Student’s Reaction to Clinical Analysis. Student surprised at ac- 
curacy of analysis. Admits depression which she is trying to hide. 
Attributes disgust and hate to home conditions. 
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CasE 5 





CASE NO. 5 AGE 26 SEX M IQ 115 AVERAGE GRADE 1.42 





PRESSEY X-0 TEST SCORES 
WMEY WILL~ TEMPERAMENT 
Total Aff. 154 Total Id. 39 bo ss 


Differential Score -6 


° 


Profile of Test I 


Profile of Test IV 


Cc rRoaeH RB Ow wo lo 






































Observational Analysis I. An extremely aggressive individual who 
likes to be in the front ranks in any situation. Dogmatic. With 
complete assurance. Fits into the group fairly well, although, as we 
should expect from this type, has frequent minor clashes. Seems 
capable of doing a high grade of work, but apparently is too much 
interested in other things to really take his work seriously. A primary 
intrevert. 

Observational Analysis II. Intelligence fair. Slightly below average 
asastudent. Perhaps does not concentrate his attention on his studies. 
Good initiative. Fair in co-operation. Excellent in expression. 
Slightly egotistic. Good in leadership. 

Clinical Analysis. High strung, active individual. Probably 
involves a sickly background. The whole balance is nearly normal. 

Student’s Reaction to Clinical Analysis. Student tells of sickly back- 
ground which surrounded life up to late in high school. Cannot under- 
stand how this was discovered, since he now enjoys good health. 
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CasE 6 





CASE MO. 6 AGE 1S SBXM IQ21) AVERAGE GRADE 2.40 


PRESSEY X-O TEST SCORES 
Total Aff. 175 Total Id. 50 DOWNEY WILL~ 
Differential Score -2 PROFILE 





Profile of Test I 























= 
D B 
7 Cc 
8 D 
Ss z 
Pf F 
Profile of Test IV G 
P H 
N I 
s z 
M K 
H L 
BROTEMARKLE COMPARISON TEST TOTAL DEVIATION 20 
I 0 v ° 
II tet eee vI Ee FE ; wy 
IIIz siiaoolh VII Q 








At Oe a @ 














Observational Analysis 1. This young man is attractive and pleasant 
in his manner. Apparently he has no problems nor does he cause any. 
Is not aggressive, but on the whole modest and retiring. All in alla 
normal, stable type. 

Observational Analysis II. Good intelligence. A good student. 
Co-operative. Fairly good in leadership. Not very emotional. 
Dependable. 

Clinical Analysis. Deviates on Expressive-Regressive Attitude, 
which indicates shyness. Slightly neurotic. On the whole a balanced 
temperament. 

Student’s Reaction to Clinical Analysis. Satisfied with the analysis, 
but objects to being labeled as shy. 
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CasE 7 





CASE NO. 7 AGE 26 SEX F 1Q126 AVERAGE GRADE 5.00 


PRESSEY X-0 TEST SCORES nats ean bees 
Total Aff. 159 Totel Ia. 39 ee ee 


Differential Score 2 





Profile of Test I 
































A 
D B 
Fr c 
8 D 
8 E 
Zz F 
Profile of Test IV G 
P x 
¥N I 
8 z 
” K 
E L 
BROTEMARKLE “COMPARISON TEST TOTAL DEVIATION 28 
I ie % Vv ° 
I kere ae vI (ile ni 0 
III -Secd VII a Mae 
Iv 

















Observational Analysis I. This student has a splendid personality 
and high intelligence. Is well liked and one who would be prized as an 
acquaintance. Shows self-confidence and assurance, but does not push 
herself forward offensively. Is very ambitious in the right way and 
shows great capability in many directions. 

Observational Analysis II. An excellent student. Intelligent. 
Good initiative. Co-operative. Quick in movement. Emotional. 
Very dependable. Good in leadership. 

Clinical Analysis. Deviates on orientation, on sex, and on disgust. 
Fair temperament, smooth and balanced. Having a terrific struggle in 
her inner life. Trying to appear indifferent to sex which is her prime 
interest in life. Anxious to be ambitious. Fights problem of 
indifference. 

Student’s Reaction to Clinical Analysis Admits a sex problem 
(disappointed in love) but thought that she had settled it many years 
ago by throwing whole life into career. Surprised to find it analyzed. 
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CasE 8 





CASE NO. 8 ACE 18 SEX F 1Q1]4 AVERAGE GRADE 2.55 





PRESSEY X-0 TEST SCORES 
DOWNEY TEMPERAMENT 
Total Aff. 206 Total Id. 43 } aes 


Differential Score 4 


Profile of Test I 





“omnoawy 
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Observational Analysis I. Very active type. Average intelligence 
but not much disposition to use it. Has a serious lack in regard to 
propriety ; being apt to get into all kinds of trouble. Thinks after acting 
wrongly, rather than before. 

Observational Analysis IJ. Intelligent. Excellent ability which is 
not always used. Initiative good. Inclined to resent direction. 
Flighty. Flippant. Inclined to attempt to deceive. Emotional. 
Affectionate, lighthearted, gay, happy. 

Clinical Analysis. Extreme deviation on Expressive-Regressive 
Attitude, Mal-adjustment is extreme. Slight emotional tinge as 
background. Shut-in type. Self-conscious, depressed, hyperchon- 
driacal background. A primary introvert. Can rationalize, but 
cannot function because of emotional background. Lacks will power. 
Going to have trouble in most situations in life. If there is time to 
rationalize, will pass in most situations, but under pressure will fail. 

Student’s Reaction to Clinical Analysis. Admits her greatest weak- 
ness in inability to look ahead and see consequences of actions. Many 
troubles caused by it. 
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Observational Analysis I. This young man has average ability 
coupled with a serious purpose, enabling him to turn out high grade 
work. Is pleasant and interesting in manner, although somewhat 
retiring. The dependable sort of individual. 

Observational Analysis II. A good student. Intelligent. Co- 
operative. Good in leadership. Not very emotional. Very de- 
pendable. 

Clinical Analysis. Somewhat poor orientation. A normally bal- 
anced temperament, with perhaps slight tendency to depression. 

Student’s Reaction to Clinical Analysis. Feeling of instability 
because not settled on vocation, although Junior in college. Depression 
due to home background. 
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CasE 10 
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Observational Analysis I. Here is a case of an individual as change- 
able as the winds themselves. Seems to lack any decisive control. Is 
undoubtedly capable of doing fair work, but is apparently too lazy to 
make the effort. Self-conscious in a high degree. Very apt to lose 
control. The weepy type. 

Observational Analysis IJ. Slow of movement. Not very emotional. 
Intelligence fair. Slightly below average in reasoning. Fairly easily 
influenced for the right. Requires coaxing. Fairly trustworthy. 

Clinical Analysis. Balanced temperament. Slight emphasis on sex; 
correlating with emphasis on disgust and self-consciousness. Fairly 
smooth emotional curve. Am suspicious that she has a problem which 
might be the balance of sex to life, due to adolescence. Lazy. Slow 
development. Prebably this case represents a slow development of 
adolescence. Upon completion of development, may be brilliant 
success. 

Student’s Reaction to Clinical Analysis. Admits self-consciousness. 
Objects to being called lazy. 
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Observational Analysis I. This person is deliberate but purposeful 
and conscientious. He has a fine intellect and plenty of ambition to use 
it. Does excellent class-room work. Is well liked by the group. 

Observational Analysis IJ. Anexcellent student. Good intelligence. 
Co-operative. Very dependable. Not very emotional. 

Clinical Analysis. Good balance in emotional response, with no 
specific defect. Normal in emotional spread. Fair activity. Em- 
phatic aggressive background. 

Student’s Reaction to Clinical Analysis. Student questions aggres- 
siveness at first, but upon reflection agrees that the analysis is a fair one. 
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CasE 12 
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Observational Analysis I. This case is a hard one to judge, since she 
is stillimmature. She has good intelligence and does excellent work in 
classroom. In general a rather easy-going type. 

Observational Analysis II. A fair student. Fair in intelligence. 
Buoyant in spirit. Co-operative. Easily lead. Fair in dependability. 
r Clinical Analysis. Deviation in Expressive-Regressive Attitude, 
Basic Moral Judgment, and Orientation. Slight mal-adjustment in 
emotional response. Basically emotional and intellectual as opposed 
to physiological. Activity low. Typical case of slight mal-adjustment 
in unbalanced adolescence. Tries to rationalize everything. 

Student’s Reaction to Clinical Analysis. Has trouble getting along 
with folks, expressed internally. Some doubting. 
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Case 13 
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Observational Analysis I. Has average ability. Shows occasional 
outbursts of enthusiasm or depression. Plenty of assurance which is 
apt to show itself in stubbornness. Not apt to be popular. 

Observational Analysis II. A good student. Intelligent. Not very 
emotional. Fairly easily influenced. Fair in dependability, unless 
influenced by others. 

Clinical Analysis. Reaction profile reveals a physiological back- 
ground. Unstable emotionally; but the temperament defect is physio- 
logical. The disturbance may be internal, and any trouble will be 
adjustment within herself rather than with the group. Conduct in 
group usually satisfactory. 

Student’s Reaction to Clinical Analysis. Sickly background and 
general weak physical condition which cause worry and depression. 
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Case 14 
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Observational Analysis I. A strong aggressive type, apt to border 
on the dogmatic, however. Has good ability and can do an excellent 
piece of work when he so desires. Is not especially popular in the 
group, which is probably due to his self-satisfied air. 

Observational Analysis II. A good student. Fair in intelligence. 
Not very emotional. Fair in reasoning ability. Trustworthy. 

Clinical Analysis. Deviation in emotional response. High-strung, 
neurotic, and self-conscious. Temperament unbalanced. Introvert 
type. Slight activity with high aggressive control. Excitable. Prone 
to be in all sorts of mal-adjustment. 

Student’s Reaction to Clinical Analysis. This student was chagrined 
at the uncanny way in which the secrets of his life, which he was at- 
tempting to hide and overcome, were brought to light. 
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Observational Analysis I. Avery active type who likes to be a leader, 
but often shows poor judgment in doing it. Is apt to flare up on slight 
provocation. At times indifferent, but may become very enthusiastic 
over certain things on occasions. Is moody and changeable. 

Observational Analysis II. A good student. Intelligent. Reason- 
ing not always sound. Emotional. Sensitive. Co-operative. Good 
in dependability. 

Clinical Analysis. Very good balance and excellent emotional re- 
sponse. Slight fluctuation within normal range, with fluctuations in 
control. Borders on type which is apt to change in a second—one thing 
now and something else next moment. Schizophrenic type. 

Student’s Reacton to Clinical Analysis. Admits fluctuation, but 
objects to being called extreme changeable type. 
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Observational Analysis I. Average intelligence with not too much 
ambition. A likeable, easy-going sort of person. Has a pleasing way 
and would always fit into a group. 

Observational Analysis IJ. About an average student or slightly 
below. The same in intelligence. Not very emotional. Somewhat 
retiring in disposition. Slightly below average in dependability. 

Clinical Analysis. The same type as Case 14. More self-conscious 
but less temperamental. The fluctuation is rather mental than 
emotional. 

Student’s Reaction to Clinical Analysis. Analysis points out some 
things correctly, principally high-strung type and self-consciousness. 
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Observational Analysis I. Average intelligence, but an aggressive 
manner and self-confidence which is deceiving. One would expect 
rather high IQ. Capable but lacks ambition. High-strung, nervous 
type. Apt to be critical and dissatisfied. 

Observational Analysis II. Intelligent, excellent in control ability, 
though not always used. Resents direction and especially dictation. 
Emotional. Behavior directed by intelligence. Inclined to deceive. 
Poor in dependability. 

Clinical Analysis. Fluctuating type, comparable to Cases 12 and 14. 
Apttobelazy Feeling background is off. 

Student’s Reaction to Clinical Analysis. Self-conscious in extreme 
degree—due to internal physiological condition. Prone to worry and 
lose control emotionally. 
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CaseE 18 
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Observational Analysis I. Strong intelligence but apparently weak 
control. Apt to flare up. Seems to be lacking in judgment. Does not 
seem to fit into group very well. 

Observational Analysis II. A good student. Fair in intelligence. 
Emotional. Slightly sensitive. Co-operative. 

Clinical Analysis. Very low on Expressive-Regressive Attitude. 
Does not know how to react to anybody. Shut-in self-conscious type. 
Apt to ‘“‘get in dutch.”’ Lacks knowledge of proper response in given 
situation. 

Student’s Reaction to Clinical Analysis. No interview. 
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Observational Analysis I, This case is a hard one to deseribe, since 
the individual is very changeable. Is easily upset and prone to be 
offensively aggressive when will is crossed. On the other hand, can be a 
perfect gentleman in all respectsif he chooses. Apparently some serious 
defect in control. 

Observational Analysis IJ. Slow in movement. A poor student. 
Does not always study. Habitsnot good. Sulky. Desirous of having 
his own way. Poor in dependability. Fair intelligence. 

Clinical Analysis. Good emotional response. Evenly balanced 
will-temperament. Fair balance in emotion and temperament spreads. 
Melancholic and hyperchondriacal background. Primary introvert 
whose conduct is highly over-emphasized. Apt to force himself. He is 
smooth enough to hold his balance in most situations. 

Student’s Reaction to Clinical Analysis. Student flattered by analy- 
sis. No particular reaction. 
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Observational Analysis I. This individual has good intelligence and a 
pleasing personality. Gets along well with the group. Takes life 
seriously and consequently worries a great deal. Very self-conscious 
and lacks aggression. Capable and conscientious, however, and with 
good underlying purpose. 

Observational Analysis IJ. A good student save for physical handi- 
cap, viz., eyesight. Good intelligence. Fair in reasoning. Good in 
leadership ability. Emotional. Rather sensitive. 

Clinical Analysis. Normal fluctuating balance. Slightly self- 
conscious. Low activity with high control. Neurotic type. Can be 
very nice, but, on the other hand, is capable of being very nasty if 
control breaks down. 

Student’s Reaction to Clinical Analysis. Feels self-consciousness is 
one of her weaknesses. Very nervous, especially when tired. General 
health not up to par. 
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Discussion 


The reader will find it very interesting to draw his own con- 
clusions as to the validity of the clinical analysis and the cor- 
relation between the three analyses. It appears that on the 
whole there is just as much relationship between the clinical 
analysis and either of those based on observation as between the 
two based on observation. There is no striking difference of 
opinion in any case except, perhaps, in case 2. 

The writer interviewed personally each case after all the data 
had been assembled. The purpose was to check the clinical 
analysis by the student’s own opinion of himself. In practically 
every case the student felt that the analysis was a fair and 
accurate one. Only afew objections were raised by the students 
interviewed, and these will be noted under the head, ‘“Stu- 
dent’s Reaction to Clinical Analysis,’ placed under “Clinical 
Analysis.” 

One case stands out as concrete evidence of the value of the 
clinical analysis, namely, case 8. It will be noticed that all 
three analyses are in perfect agreement. It might be added 
that this young lady was in serious trouble several times during 
the year. If the results of the clinical analysis had been in the 
hands of the administration at the opening of the year, much of 
the mal-adjustment might have been eliminated. 

Perhaps the most significant fact revealed by the case studies 
was the fact that the clinical analysis gave important informa- 
tion not even hinted at by either of the observational analyses. 
This was particularly true in four cases, nos. 1, 5, 7 and 14. 
The clinical analysis of case 1 states that the individual has an 
extreme attitude of disgust and is depressed over suspicions. 
In the interview, this person admitted that he felt disgust or 
very strong dislike for no less than five of the students who are 
his daily associates. He also confessed that his boyhood was 
spent in a community where he had, sooner or later, to engage 
in fistic combat with every boy in the school. The analysis of 
case 5 indicates a sickly background. The interview confirmed 


8 Unable to interview case 18. 
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this statement, the young man having been sickly all through 
his school days. Neither observer would have ever suspected 
it, since the young man at the present time has an apparently 
strong body. Case 7 presents an interesting example of the 
value of the clinical analysis. The analysis states that the girl 
is trying to appear indifferent to sex—really the prime interest 
in her life. Neither of the observational estimates so much as 
hint at any problem in her life. Yet upon interview, this young 
woman admits that she was disappointed in a love affair several 
years ago, and is throwing her energy into religious work as a 
compensation reaction. She could not understand how the 
test could discover it, for she had thought that this problem in 
her life had been settled many years ago. Case 14 should be 
mentioned since the individual admitted that the analysis fitted 
him in every particular. He was sorry, however, that the 
writer had found out about his real self, since he had been trying 
to cover it up. 


- CONCLUSIONS 


Certain conclusions are indicated as follows: 

1. The statistical method of comparison of averages and total 
scores is not ample as a check on the validity of the tests 
examined. 

2. In the hands of one dependent upon statistical test 
measurements and unskilled in clinical analysis the tests ex- 
amined fall far short of their intended use. 

3. In the hands of an experienced clinician, the scores from 
the tests examined serve as a basis for reasonably accurate and 
valuable analysis. 

4. Under certain conditions it would seem feasible for one 
skilled only in the administration and scoring of these tests to 
compile the data on a single sheet, which may be sent to an 
experienced clinician for analysis. 








WHAT IS MEASURED BY THE IOWA “APTITUDE” 
TESTS? 


T. A. LANGLIE 


Wesleyan University 


In an article entitled Analysis of the Iowa Placement Tests, 
published in the JouRNAL or APPLIED Psycuo.ocy (1926, vol. x), 
the writer concluded among other things, that 


(1) Each test is dependent to a fair degree upon intelligence, par- 
ticularly the aptitude tests. 

(2) A particular aptitude is dependent upon training in that partic- 
ular line. 

(3) Aptitude (is) general intelligence plus training. 


The placement tests studied were the Chemistry Aptitude, 
Chemistry Training, English Aptitude, English Training, 
Mathematics Aptitude, and Mathematics Training, and the 
above conclusions were derived by correlational studies, zero 
order and first order partials. By ‘Intelligence’ was meant 
that which is measured by our so-called intelligence tests, and 
by “training” was meant any experiences which had resulted 
in a modification of the individual’s habit systems, whether 
it be the taking of a course in chemistry, mathematics, or 
English, or other less formal methods of instruction, such as 
reading of scientific or semi-scientific journals and books, etc. 

Stoddard, in an article published in the Seashore Commem- 
orative Number of the Psychological Monographs (vol. xxxix, 
no. 2, 1928), criticizes the above mentioned conclusions, as 
being due to an error of sampling. He says, 
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Langlie’s second statement is essentially fallacious, for it arises out of 
an accident of sampling. All subjects who took the aptitude tests had 
really studied the subject matter for which the tests were designed 
to measure aptitude. For example, the same students took both the 
Chemistry Aptitude and Chemistry Training Examinations. Since 
they have studied chemistry in high school, there was a correlation be- 
tween chemistry aptitude and chemistry performance. But the 
Chemistry Aptitude Examination is designed principally for those with 
no training in chemistry; when given to such students it surely becomes 
meaningless to say that aptitude depends upon training. 


His criticisms of conclusions (1) and (2) are based on the same 
foundation as the above criticism, and although the discreet- 
ness of these aptitude tests has not been shown, he implies that 
the tests are “specific.”’ 

If the aptitude tests do not depend upon training, students 
who have had no chemistry training should score as high on the 
average as students who have studied chemistry in high school. 
But such is not the case, for students who have studied chem- 
istry before entering college score significantly higher in the 
aptitude test than do students who have had no previous 
scholastic training. The following table reveals the extent of 
these differences, as well as the lack of differences in “intel- 
ligence.”’ 

Means, 8.D’s, and 8.D’s of the Differences between Means, 
for various groups of students as measured by an intelligence 
test, and by the Iowa Chemistry Aptitude Examination. 
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Similar results were obtained with the 1925 classes, as 
follows: 
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It is apparent from an inspection of the above comparisons 
that the groups do not differ in terms of “general intelligence,’ 
but do differ significantly in terms of the Chemistry Aptitude 
Examination scores, the differences between the means being 
more than three times the standard deviation of the difference, 
and in favor of the Chemistry 4 groups who had studied chem- 
istry in high school. 

The only conclusion that seems possible is that these apti- 
tude tests measure “training” to some extent. The earlier 
analysis indicates that they also measure intelligence to some 
extent. Such conclusions do not detract from the value of such 
examinations for prognostic purposes, however. As a matter 
of fact, the writer has concluded elsewhere! that for such use 
measures of ‘‘training’’ are more valuable than measures of 
“aptitude.” 


1 A Comparison of ‘‘Aptitude’’ and “‘Training’’ Tests for Prognosis, 
Jour. Educat. Psych., December, 1928, vol. xix, no. 9. 











A STUDY OF THE PRESCHOOL CHILD’S PICTURE 
AND STORY BOOKS BY THE BATTERY OF TESTS 
METHOD 


ELEANOR OLMSTEAD MILLER 


Jacksonville, Illinois 


In order to determine an individual’s aptitude for a given 
vocation, the battery of test technique has been developed as 
described in Professor Clark L. Hull’s Aptitude Testing. This 
same method may be applied successfully, however, in 
other fields. 

In studying the preschool child’s picture and story books, if 
we can secure a representative group of these books and have 
them ranked in order to form a criterion, we may then measure 
them in any given number of attributes, or “aptitudes,”’ hence 
discovering which ones play the greatest part in determining 
the desirability of a given book. This knowledge built into a 
multiple regression equation gives us a basis upon which we can 
judge other and newer books as related to these which form the 
criterion group. In this way we use the battery of tests method, 
as used in aptitude testing, for a different sort of problem. 

The following account of this method of studying children’s 
books constitutes only a part of a much more comprehensive 
study. Many more factors enter into a child’s book than can 
be measured objectively; such factors as story content, subject 
value, etc. This brief report attempts in no sense to be com- 
plete as a study of the preschool child’s picture and story books. 

It is to be noted that the study of the preschool child’s book 
is made, not only from the standpoint of his own interests, 
important as those are, but also from the standpoint of the 
opinion of specialists regarding the books to be given to him. 
The preschool child’s first books are given to him: he does not 
select them for himself. 

To form a criterion group of books is obviously the first task 
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in this problem. The preschool period was divided into two 
parts—children below three, and those from three to five years. 
Sixty books were secured for the first age group. Since this 
group of books was to be as representative as possible, they were 
collected in several different ways and represent good, poor, and 
indifferent books. A number of books was selected from book 
lists of so-called desirable books for children of these ages; a 
number was secured by going to book stores and asking clerks 
to recommend books; a third number was secured which mothers 
had actually used with preschool children; and, finally, a small 
number was obtained from a group of books given one certain 
preschool child by relatives and friends. Sixty is about the 
smallest number of cases—or books—which can be used for 
valid statistical purposes. But in selecting the books for the 
second age group it became evident from preliminary rankings 
that it was well nigh impossible for rankers to rank anywhere 
near this number of books. The books for the older group are 
longer, more varied, and altogether more difficult to hold in 
mind for ranking purposes. Hence the exactness of statistical 
procedure is sacrificed in the second group in order to have a 
more valid criterion. Only twenty-five books comprise the 
second age group. 

Ten people ranked each group of books. Five of each ten 
were professional men and women who were working with or 
particularly interested in preschool children. The other five 
in each ten were mothers who were particularly interested in 
preschool activities and had children of preschool age at the time 
they did the ranking. 

These rankings were then summarized and converted into an 
array of scores on a convenient linear scale of ten units by the 
method devised by Professor Clark L. Hull in the University 
of Wisconsin Psychology Laboratory. Correlations were then 
found between the scores of the rankers by the Pearson-Product- 
Moment method with the simplified formula: 

Man — My: Mg 


~ /My, — (M,)? VMg, — (My)? 





r 





The correlations averaged .40 for Group I and .36 for Group II. 
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In order to form a criterion for the scores of the two groups 
of books, the scores given the books by the various rankers were 
averaged. These criterion scores were then correlated with 
the scores from each ranker. These correlations with the 
criterion averaged .62 for Group I and .65 for Group II. 

We now have a criterion for each group of books. The cor- 
relations found in obtaining it are low, so low as to seem dis- 
couraging when we find the efficiency of prediction from 
the formula 


E=1-VYi-r 


Using this formula we find that in only 22 per cent of the cases 
in the first group and 24 per cent of the cases in the second group 
can we predict from the criterion how these people would rank 
the book. But probably these values are as high as we may 
expect when we consider the intangibility of the problem. 
Other studies of a more definite nature growing logically out of 
this one should give better results. 

The books in each group were measured in a number of 
factors. These measures were correlated with the criteria 
with the results given in table 1. 

In computing a multiple regression equation, it is desirable 
that the factors we use correlate as high as possible with the 
criterion and as low as possible with each other. Thus we have 
selected certain factors which seemed to make the best showing 
when correlated with the criterion and then correlated them 
with each other. Selecting then the most important factors 
according to the principle mentioned above, a multiple regres- 
sion equation was computed for each group, using Yule’s 
method as worked out by Tolley and Ezekiel and used in the 
Psychology Laboratory at the University of Wisconsin. These 
equations are as follows: 


Group I: X; = .025X. + .005X; — .0006X, + 3.82 


In this equation we may substitute the per cent of pictures 
for X, the number stories for X3;, and the average number of 
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words per story for X, and thus obtain a value for X;, which 
would compare any new book with those already ranked. 


Group II: X; = .04X, — .008X; — .04X, + .01X, + 5.26 


In this equation, the cost would be substituted for X2, the 
area for X3, the per cent of pictures for X,, and the number of 
story pages for Xs. 


TABLE 1 





CORRELATION WITH 


CRITERIA 
ATTRIBUTE 





Group I Group II 





.12 


Number colored pictures 

Average size pictures 
NG. . . cciinbatcecsecegedas debme 
Total number pages 

Number story pages 

Number stories 24 
Number illustrated stories......................... 
Average number words per story...................| —.18 











All books contain many factors which cannot be measured by 
any device such as that mentioned above. Here come ele- 
ments of literary merit and understanding. Certain facts may 
be mentioned about the books which were not considered above. 

1. There seems to be no relationship between the rank of a 
book and its presence or absence on book lists. Book lists are 
best when they serve only as a means of introducing books. 
We need in addition some objective method of consider- 
ing a book. 
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2. Desirable characteristics of a book are timeliness in 
illustrations, well fitted to a child, offering opportunity for 
originality, and expression of individuality. 

3. Another desirable trait is found to be strong rhythm or 
jingle quality. Thus the fundamental need for Mother Goose 
does and probably always will exist. 

4. Undesirable qualities of books low on the scale are unat- 
tractive binding, lack of durability, and too small in size. 

5. The ABC method of arrangement is an undesirable one. 

6. Fairy tales had better be left until eight or nine years and 
then given in the original forms. 

We may now bring together what facts and opinions we have 
gathered including correlation coefficients, means of various 
attributes, comments of rankers, etc., and form a score card 
to be used in rating children’s books. Such a score card follows: 


Score Carps ror Books ror PREscHOOL CHILDREN 


Decide for what age child (mental age is more reliable than 
chronological age) the given book is to be rated. Rate ac- 
cording to the following points: (Group I is for three years 
and under; Group II for three to five years). 


I. Physical Aspects of Book. 
1. Size 


Group I Group II 


For area of about 68 sq. in., For area 54sq. in., give 4 points 
give 6 points. Subtract one Forarea 49 sq. in., give 5 points 
point for each 5sq.in. above For area 44 sq. in., give 6 points 
orbelow. Minimum 0. Continue at 6 points to 34 sq. 

in. . 

Below 34 sq. in., reduce 1 point 
for each 5 sq. in. reduction in 
area 

For area 59 sq. in., give 3 points 

For area 64 sq. in., give 2 points 

For area 69 sq. in., give 1 point 

For area 74 sq. in. and above 
give 0 points. 

Maximum Value 6 Points 
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2. Weight 
For weight 360 grams or less give 4 points. (Approximately 13 
ounces) 
For every 25 additional grams (about 1 ounce) reduce by 1 point 
with 0 as minimum. 
Maximum Value 4 Points 


3. Paper 
Estimate quality—finish, durability, binding, etc. 
Maximum Value 4 Points 
4. Pages 
Group I Group II 
For 53 pages give 4 points For 135 pages give 4 points 
For 57 pages give 3 points For 145 pages give 5 points 
For 62 pages give 2 points For 155 pages give 6 points and 
For 67 pages give 1 point continue at 6 points 
For 73 pages give 0 points For 115 pages give 3 points 
Continue at 0 For 105 pages give 2 points 
For 48 pages give 5 points For 95 pages give 1 point 
For 43 pages give 6 points For 75 pages or less give 0 points 
Continue at 6 points to 25 pages 
Under 25 pages reduce 1 point 
for each 5 pages. 
Maximum Value 6 Points 


Total Maximum Value 20 Points 


(For Group II add 1 point if book costs $1.19 or more; 2 points if 
$1.50 or more). 


II. Pictures 
1. Size 
Estimate, making decreased amount for very large or very 
small pictures. 
Maximum Value 5 Points 


2. Number 
Give 3 points for 50 pictures. Increase or decrease 1 point for 
each ten pictures more or less and continue at maximum or 
minimum. 
Maximum Value 5 Points 


3. Percentage 


Group I Group II 
For 54 per cent give 5 points For 26 per cent give 5 points 
For 59 per cent give 6 points For 31 per cent give 6 points 
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Increase 1 point for each 5 per cent of increase with maximum at 


10 points. 
Decrease 1 point for each 5 per cent of decrease with minimum at 
0 points. 
Maximum Value 10 Points 
4. Quality 


Estimate quality on basis of clearness, color, line, subject, ete. 
Maximum Value 10 Points 
Total Maximum Value 30 Points 


III. Stories 


1, Length 
Group I Group II 
Give 3 points for story of 450 Give 3 points for story of 1600 
words. words. 


Increase points value if number of words is below; decrease if above. 
Maximum Value 5 Points 


2. Correspondence to age 
Estimate as to simplicity, repetition, plot, etc. 
Maximum Value 10 Points 


3. Amount of rhythm 
Estimate, giving Mother Goose rhymes 5 points, others ac- 
cordingly. 
Give 0 where no rhythm appears. 
Maximum Value 5 Points 
4, Subject 
Estimate according to familiarity to child of age considered. 
Maximum Value 10 Points 


5. Vocabulary 


Estimate according to age of child considered. 
Maximum value 5 Points 


Total Maximum Value 35 Points 
IV. Author, Artist, Publisher. 


Estimate, according to actual acquaintance, as far as it can be de- 
termined with children or previous success with children’s books. 


Total Maximum Value & Points 
V. Construction of Books. 
Estimate, according to materials, binding, etc. in connection with 
age for which intended. 
Total Maximum Value 10 Points 


Grand Total Maximum Value 100 Points 
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In conclusion, it may be stated that while we obviously have 
not discovered any great or momentous fact in regard to chil- 
dren’s books from the method here employed, we have shown 
that this method—a far more accurate one than the usual 
methods for evaluating children’s books—could be used with 
greater success with a more homogeneous group of books. Our 
problem is probably too broad and too intangible to gain much 
definite information. It does suggest, however, points at which 
the same method might be applied with promise of greater 
success. An investigation is already under way with Mother 
Goose books and promises more tangible results. 

We have presented a score card which has already been used 
with some of the newer books with success. It should be 
valuable to the book reviewer or to the individual who selects 
children’s books, in the same way as the multiple regression 
equation is valuable to the vocational expert in selecting indi- 
viduals for a given vocation. 
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THE RELATIVE EFFECTS OF SIZE OF TYPE, LEADING 
; AND CONTEXT 


HOWARD T. HOVDE 


University of Pennsylvania 
SCOPE OF THIS INVESTIGATION 


The experiment, reported in this paper, was conducted 
originally in an effort to determine the relative legibility of 
Intertype Ideal News Face Type, set under standard newspaper 
publishing conditions, with changes in size and leading. The 
results show the relative effects of size, leading and context. 
The experiment is divided into two parts: Part I records the 
direct measurement of the reading rate of 300 adults; Part 
II describes the readers’ preferences and opinions of the legi- 
bility of the type setting. 


HISTORICAL NOTES ON LEGIBILITY 


A complete review of the literature on this subject would include 
several hundred titles. Anyone interested in more detailed references 
than can be included here will find two bibliographies independently 
compiled by Pyke (35) and by Tinker (41), with accompanying digests of 
the subjects. Research in this field has been undertaken by numerous 
educators, ophthalmologists and psychologists. The approach to the 
subject has been largely psychological. Banister (3), working with test 
type charts of ophthalmic standards, concluded that errors often at- 
tributed to physical defects of the eye are due more likely to psycho- 
logical causes and that psychological tests are a particularly desirable 
approach to the problem. 

Two favorite methods of investigation are prevalent. The first is the 
test for legibility of isolated letters and numerals of which the Snellen 
Chart of the ophthalmologist early served as an introduction to the 
general problem. The second is the test for legibility of continuous 
reading for context with which this paper is concerned. 

Under the first method, the work in ophthalmology may be men- 
tioned. Hartridge and Owen (20) discuss the merits of the Snellen and 
the Green test types in ophthalmic practice. Cowan (10) calls attention 
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to the failure of ordinary type to satisfy the psychological requirements 
of a test for visual acuity and makes suggestions for changes in the char- 
acter and the design of letters of equal legibility. In a second paper 
(11) he reviews the field of test letters and geometric designs for the 
determination of visual acuity. 

In the field of psychology, Roethlein’s comprehensive study (38) 
of isolated letters has received wide recognition, and more recently 
Tinker (42-44) has been interested in the study of isolated letters, 
digits and mechanical signs. Crosland and Johnson (12) have studied 
the range of apprehension as affected by inter-letter hair spacing and 
by characteristics of the individual letter. In the main these tests 
meet the criticism of Ewing (15), in a discussion of the value of letters 
and characters as visual tests, who concludes that 62 per cent of normal 
vision is sufficient for ordinary use and that the army accepts men with 
50 per cent vision of the ophthalmic standard and with 75 per cent 
vision for the finest rifle work. Parsons (34) rightly contends that the 
characteristic group of the letters are attended to in the reading process 
and not the individual letters. In general, the method of investigation 
for the legibility of isolated letters has met with criticism by those who 
have studied reading habits. 

Under the second method, the inquiry into reading habits permits a 
different approach to the subject of legibility. The reading process 
has been studied experimentally by Javal (25), Erdmann and Dodge (14), 
Huey (21-23), Quantz (36), Dearborn (13), and more recently by Judd 
(26), Gray (18), Schmidt (40), Buswell (7-8) and others. Cattell (9), as 
early as 1885, produced strong evidence that reading proceeds not by 
successive letters but rather by whole words, phrases and sometimes 
short sentences as units in the perceptual process. Reading involves a 
series of eye movements across the line of type. The eye pauses between 
movements and is fixed upon a word or group of words. During these 
fixations comprehension takes place, as nothing is seen while the eye is 
in motion. At the end of the line a regressive movement is made to 
the first word in the next line and the eye again continues its broken 
sweep across the line. Experimental studies of this nature have been 
largely responsible for the discard of the assumption that reading takes 
place by the alphabetical method; namely, that the reading process 
proceeds by successive letters and not by word, phrase and sentence 
wholes. 

The reading of any consecutively written material relies upon context 
for the derivation of its meaning. In this usage the word ‘“‘context’’ 
includes that which might be amplified into the term ‘‘contextual 
meaning’’ but which is inferred by the single word. Buswell (7) has 
given a clear analysis of the complex character of meaning underlying 
the general process of thought that is included in the context, and Huey 
(23) has similarly interpreted this idea. 
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In considering the sensory content of reading material, a variety of 
conflicting opinions and contradictory recommendations have arisen 
from experimental evidence. A few of these observations may be con- 
sidered. 

Size and Face of Type: Pyke (35) experimented with 8 different type 
faces and found rather large legibility differences in one test and small 
and conflicting differences in the other tests. He concluded that 
extremely large typographical differences must be present before it is 
possible to discern differences in legibility. He used the tachistoscopic 
method of exposing the reading material and doubts whether the differ- 
énces in legibility found in the laboratory experiments hold true under 
ordinary reading conditions. Huey (23) concluded that the size of type 
is perhaps the most important single factor in legibility. Roethlein 
(38) stated that the legibility of a face undoubtedly increases directly 
with the increase in the size of aface. Freeman (16) found that 7 point 
type was read more rapidly than 11 point type and that the smaller 
type face seemed to allow somewhat greater scope of fixation, but that 
the number of fixations per second did not increase. However, Judd 
(26) found that the rate of reading and span of recognition are only 
slightly altered by doubling or halving the body size of aface. Parsons 
(34) is not opposed to condensed letters and thinks there may be an 
advantage inthem. Huey (23) found that there is probably little to be 
gained by increasing the distance between letters (spacing of a word) 
beyond that which is used in the better printed books at the present 
time, although when the same number of words was printed in fewer 
lines of the same length and the same size of type, the material was read 
faster in the same proportion that the lines were decreased. Tinker and 
Paterson (44) obtained a speed of reading record for text which was set 
in roman lower case, italics and all capitals, and found the relative 
legibility of the type setting to be in the order named. 

Leading: Noticeable differences have been found in extremely wide 
typographical settings in size and leading. Bentley (4) investigated 
Monotype News Gothic set in 12 point type and photographic reductions 
to correspond to 9 point and 6 point. He used as a criterion the time 
taken to read a given amount and concluded that 7 point leading for 
12 point type, with corresponding equivalents in the smaller faces, 
resulted in the greatest savings, averaged at the rate of 4 minutes 
per hour. Typical newspaper reading conditions, however, were not 
present during the testing. Huey (23) found that leading was of no 
value when the size of type was less than 1.5 mm. for lower case non- 
projectors. Parsons (34) concluded that the advantages of leading are 
almost negligible. Kerr (28) believed that legibility appeared to in- 
crease with leading but probably decreased as soon as one line above 
or below came within the small fixation area of distinct vision. Two 
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opposing results are to be found on the question of leading in the studies 
of the legibility of the telephone directory. Baird (2) concluded that 
within certain limits, legibility varied directly with the thickness of 
leading. Lyon (30) subsequently found, yet without reference to 
Baird’s work, that there was no measurable difference between 6 point 
solid and 6 point type set on a7 point base (leading 1 point), but that 1 
point leading had greater aesthetic appeal and was generally preferred. 

Length of Line: The width of a newspaper column today is standard- 
ized. However, earlier experiments confirm certain tendencies toward 
this standardization. Dearborn (13) found that 75 to 85 mm. or 33 
inches, which is about 4 longer than daily newspapers, combined a good 
many advantages with a gauge of lower casen of 1.4mm. The shorter 
lines are probably better than the longer lines because words in the line 
below are more likely to have a sense connection while otherwise they 
distract attention. Ruediger (39) favored a maximum of 75 to 85 mm., 
no matter what the subject matter. Huey (23) preferred short rather 
than long lines with approximately 66 mm. as the optimum and con- 
cluded that the line-length of modern newspapers are perhaps as near 
the optimum (for books too) as can be determined. r 

Margin: Like the length of the line, margins are standardized in 
newspapers. Legros (29) stated that a white space should logically form 
the boundary between adjacent areas of print. He favored a slightly 
wider margin where a metal rule would otherwise be considered neces- 
sary. However, the elimination of the dividing rule is not practical in 
newspaper publishing, as discovered by the New York Morning Tele- 
graph, which attempted this recently. 

Paper: The Report of the Committee of Illuminating Rosiotacing 
Society (37) states that paper should possess a high (diffuse) reflecting 
power and little gloss. Any glazing is undesirable. Glossy inks have 
lower diffuse reflecting powers than the mat inks, hence the latter are 
blacker and present a greater contrast with the paper. Lyon (30) found 
no measurable difference between white papers and four shades of buff 
colored newsprint, although white paper had the greatest aesthetic 
appeal. 

Many typographers have judged the fitness of the printed page by its 
aesthetic appearance and its historical origin. Morison (31), among 
others summarizes as follows: (a) the essential form of the letters should 
correspond with those that have been handed down to the reader his- 
torically; (b) the composition of the letters should be agreeable to the 
words; (c) the lower case letters should be homogeneous in line and 
color; (d) the upper case gauge should be at most slightly less than that 
of the lower case ascenders. The capitals must not be conspicuous and 
“spot’’ the page; (e) there should be no extreme contrast of the thick and 
thin strokes of the letters. 
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The approach to the various problems have been varied and the 
technique is open to question. As inferred, Pyke (35), after using a 
tachistoscopic method, doubted whether the differences in legibility 
found in the laboratory experiments hold in ordinary reading. Gilliland 
(17) recorded the reading rate and eye movements of subjects who read 
two kinds of material, ranging in typesetting from 6 to 54 points and 3 to 
90 points paired with a 12 point control. Results were not significant 
between the limits of 6 to 36 points, although the rate of reading became 
somewhat slower with type larger than 18 point. 

Empirical judgments of some writers are based only on a criterion of 
aesthetic value. Historical surveys, such as Blackhurst’s findings (5) 
and Updike’s review (45), present a picture of the attempt of the print- 
ing trade to solve the problem. Manufacturers of type reflect the 
feeling that the most legible type is the one of which the greatest quan- 
tity is sold over the longest period of time. 

Experiments such as those of Dearborn (13) and Huey (21-23) have 
been conducted primarily with the object of analyzing the reading 
process. The work of Baird (2) and Lyon (30) on the telephone directory 
represents tests of speed and errors in finding a name and exchange 
number. Gray (18) studied the performance in oral and silent reading 
through the analysis of eye movements on a group of subjects of various 
intellectual atainment. Buswell (8), with a somewhat similar method 
and group of subjects, investigated the span of recognition for printed 
matter, the rate of recognition for perception units and the regularity 
of perception along the line of print. Judd and Buswell (27) had sub- 
jects read passages of various degrees of difficulty and familiarity, and 
found significant variations of reading performance in adjustment to 
the change in the content of the passages. 

The dangers of speed reading has been discussed by Buswell (8), 
Judd (26), O’Brien (32), Pyke (35), and others. Similarly, the merits of 
loud and silent reading have been weighted. Inasmuch as silent reading 
forms practically the whole of adult reading in normal life, it is preferred 
to oral reading for test purposes, although it presents test difficulties. 
Maximum and normal reading has been compared by Schmidt (40), 
Whipple and Curtis (46) and others. Reading at the normal rate ap- 
proaches the typical reading conditions, and if controllable for test 
purposes has a corresponding advantage. 

In conclusion to this historical review of legibility, it may be stated 
that many conflicting and diametrically opposing results have arisen 
out of experimental evidence from a variety of sources. This may be 
explained by the nature of the observations and the limited experimental 
data upon which conclusions have been drawn. To this fact may be 
added the great number of empirical statements that have been made 
by printers and others who have been interested in typography and who 
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have judged factors of legibility by indefinite criteria. The approach 
to the problem should be wholly scientific and the emphasis of the psy- 
chological aspect cannot be overlooked. 


DEFINITION AND MEASUREMENT OF LEGIBILITY 


The term “legibility,”! as used in this paper, refers to the 
ease and accuracy with which the type setting can be read 
under ordinary conditions. Legibility is a factor in reading, 
and reading is the process of getting meaning from the printed 
page. Therefore, legibility may be defined as reading with 
ease and accuracy, where it is understood that meaningful 
reading takes place. This usage differentiates the term from 
perceptibility or recognizability, with which the experiment 
was not concerned. 

Legibility has to do with reading in the normal and accepted 
manner. Thus the reader must sit in an upright position with. 
good illumination falling upon the reading material which is 
held at a normal distance for accommodation to the eyes. 
Conditions should be typical of the actual reading situation 
and should be free from mechanical impositions which might 
tend to distract the reader. 

The measurement of legibility? under these conditions is the 


! Pyke (35) observed that four times as many writers have measured 
legibility as have defined it. The criterion of legibility was used by 
36 writers in 98 years (1827-1924), whereas only 9 writers in 44 years 
(1878-1921) have defined legibility. Three out of every four writers have 
attempted to measure something the exact nature of which they have not 
paused to examine. 

2? Pyke (35) states that thirty-six writers have experimented and 
argued with fifteen different criteria. These are: “Measurement by 
speed of reading (by the time threshold and the amount read), the dis- 
tance threshold (direct and peripheral), ‘eye span,’ ‘illumination thres- 
hold’ focus threshold, fatigue, number of eye focuses, number of eye 
refixations, regularity of eye-movements, reading rhythm, ‘legibility 
coefficient,’ ‘specific legibility,’ size of letters, by ‘judgment of the 
trained human eye,’ and by aesthetic merit. These criteria have been 
used indiscriminately under a variety of conditions; namely, in silent 
and in loud reading, at normal and at maximum speeds, using words 
(isolated and grouped) and letters (isolated and grouped), with daylight, 
oil, and gas-light, electric light and flash-light, with continuous reading, 
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rate of silent,* mature reading. Meaningful reading must take 
place and be checked for accuracy. The continuous text may 
be measured by the amount which has been read. Inasmuch 
as the reading material may be set in large or small type and the 
leading between the lines may increase the space that the eye 
covers in gaining meaning, the reading area is not a criterion 
of legibility. The measurement can be made logically by 
counting the number of words which can be read in 60 seconds. 
This measurement assumes that the writer of the reading 
material has been concise and economical in the choice of 
words, but even if the writer has been verbose the eye must 
transverse the wordy phrases to gain meaning. The words, 
by themselves and in combination, remain the basis of the 
perceptual units from which meaning is derived. The normal 
silent reading rate should give a close approximation of the 
legibility of the type setting. 


PRELIMINARY CONSIDERATIONS 


As a preliminary approach to the problem, 106 readers were 
given a comparative test of reading material set in two different 
newspaper body faces. Reader judgments were secured, but 
as the test was not given under standard conditions, its useful- 
ness served only as an introduction to the problem at hand. 

For practical assistance and standardized typesetting, I am 
indebted to Mr. Robert McLean, Vice-President of the Phila- 
delphia Evening Bulletin, who not only appreciated the theo- 
retic problem but offered codperation greater than could be 
expected from any other source. At the time of my first 
contact with Mr. McLean, a change in the body face of the 
news columns of the page was contemplated. 





and brief exposures varying from one-thousandth of a second to one- 
tenth, and contrived with tachistoscopes of four different sorts.’’ 

* An experiment by Schmidt (40) reveals the physiological basis of 
the superiority of silent over oral reading in point of both speed and 
comprehension. O’Brien (32) observed: “Silent reading is as a rule 
a more economical and effective instrument for the assimilation of the 
thought of a passage than oral reading.’’ 
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The immediate cause of the change was the lack of legibility 
in the type used. This was determined by individual com- 
plaints on the part of readers, particularly noted when the dry 
mat for stereotyping was introduced. The dry mat or matrix 
may be contrasted with the wet mat which requires heat at a 
relatively lower pressure to form the matrix. The dry mat on 
the contrary requires much greater pressure (6 tons to the 
square inch) to form the impression on the papier-mache which 
is done by rolling the mat across the type form. The introduc- 
tion of new type faces might not have been necessary except 
for this mechanical process. In the older type face, the more 
delicate hair lines and serifs broke down under several dry 
mat impressions. Multiple impressions were necessary to 
supply five casting rooms and a battery of 32 presses. To 
illustrate the manner in which a character will break down, let 
us take the letter O. The top and bottom of this letter, in ~ 
most designs, is a hair line. The break down of this gives the 
appearance of two parenthesis marks. Again, a period may be 
battered so that it does not print an impression. The sum 
total of these faulty characteristics produced illegible reading 
and caused complaints by the readers. 

The specifications for a new type face required heavier hair 
lines. The practical problems of stereotyping and of high 
speed printing demanded this. Furthermore, a similar type 
design was preferred because of the reading habits of the 
subscribers to the paper. After considerable study, it was 
thought best to have a type face similar to the Roman face 
most often used in school books. Childhood habits formed by 
reading this style of type face would persist, with the adult 
newspaper reader. No type face which was a radical departure 
from this specification was considered. 

One rigid specification was that no type face would be 
accepted which was bastard within the range of type sizes 
customarily set for the body of a news article. This is illus- 
trated in the cutting of type faces. In some type faces, it is 
necessary to redraw the designs for extreme variations in size 
if certain characteristics of a line of type is to be kept. This is 
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usually accomplished by extending or condensing letters and by 
changes in the ascenders and descenders of the characters. 

The selection was finally narrowed down to five type styles 
which were set up for printing. Dry mats were made, which 
in turn were cast and printed according to the conditions under 
which they would be used. Of these five styles, the old type of 
the Bulletin was one. Further study proved that, of the 
remainder, only two styles were outstanding, as the charac- 
teristics of the others fell within these two styles. The conser- 
vation of newspaper printing space is important, and these 
two remaining styles offered variations in fractions of a point; 
namely, 63 and 63 point. 

The final selection of the Intertype Ideal News Face (24) 
was decided upon by the publisher after all sizes were enlarged 
by photo-engraving and minutely compared with one another. 
The rejected type style proved to be bastard in the sizes 
larger than 63 point as the whole alphabet was condensed or 
distorted in order that the total alphabet should not be longer 
than in the 6} point size. However, the rejection was based 
on the additional fact that the larger type sizes seemed to 
“dance” before the eye if leading were not used. 

Reading material for the experiment, recorded in this paper, 
was carefully considered. The selection of different material 
for the setting of each type size was necessary in order to avoid 
the influence of familiarity. Outstanding news stories of the 
year which had been published in various papers throughout 
the country were considered. After these had been compiled 
it was found that the style of writing and interest in the material 
varied to such an extent that it was not usable. Aesop’s 
Fables, essays by Emerson, Schopenhauer and others were 
considered and rejected because of lack of similarity to news- 
paper stories. 

Three factors were to be considered: (a) the material must 
be by the same author in order to avoid variations in the style 
of writing; (b) reading interest in the material must be 
sufficiently great to stimulate the normal reading rate; (c) the 
selections must be on the same level of reading difficulty. 
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The experience of editors of the Evening Bulletin was helpful 
in this regard. Over a period of twenty-five years it had been 
observed that dialect stories and stories in foreign background 
were less popular than stories of American life. A suitable 
story of common interest was found in Charles A. Lindbergh’s 
“We” which had run in serial form. From this story sixteen 
incidents of approximately the same level of continuous interest 
and reading difficulty were selected. 


TEST MATERIAL AND TYPE SETTING 


The selection of reading material which was believed to 
contain items of approximately equal interest and difficulty 
follows :4 


Column 
Column 
Column 
Column 
Column 
Column 
Column 


Lindbergh’s birth and family history. 
His educational background. 

A barnstorming trip with E. G. Bahl. 
Barnstorming with Lynch in Kansas. 
Flying his own ship. 

First cross country flight. 

Landing at Meridan in “‘Jenny.”’ 
Column Storm conditions in flying. 

Column A negro as a paid passenger. 

Column 10. Flight from Maben to Lake Village. 
Column 11. Bud Gurney’s parachute incident. 
Column 12. Skakopee in a cloudburst. 

Column 13. Information about Army Air Service. 
Column 14. Flying in Nebraska. 

Column 15. Flying cross country again. 

Column 16. Description of aeroplane parachute. 


PSX*Frrerr 


The above headings give a brief description of the nature of 
the reading material. The style of writing permitted a blending 
of incidents with one another in a manner that allowed reading 


* Among those who agreed with my personal judgment of the equality 
of the reading material were Dr. S. W. Fernberger and Mr. R. McLean 
and others who read the material for this purpose. Of unsolicited 
opinions, many of the individuals whose test results are included in the 
experiment stated that they believed the material to be uniformly equal 
in reading interest and difficulty. This fact was subsequently sub- 
stantiated by inspection of the original copy as it had been prepared 
for printing in the different type sizes and leadings. 
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with continuous interest at the beginning of every column 
without having completed the reading of the previous column. 
Paragraph indentations followed the reading context as written 
by the author, except in one or two instances where an especially 
long paragraph could be divided logically in order to equalize 
column paragraphs. The phrase “Check mark” described 
under procedure, appeared at various distances from the top 
of the column but within a distance that the slowest reader 
would find the words before time was called. Only one such 
instruction appeared to a column. 

The material was set in full newspaper page size according to 
the mechanical specifications of the Evening Bulletin: 


is wk vn tees ccnccdsnntionattnnens 17} inches 
De hi I 21,°; inches 
Single columm Witlth. :..... 06... .cc0cc cece cscs ecees 2745 inches 
Cea Be. AU a A ie ab eS 8 


At the top of the page in approximately 14-inch depth across 
8 columns were printed: 


TEST FOR LEGIBILITY OF TYPE 
Wait for Instructions Before Reading Any Column 


At the bottom of the page in approximately 2 inchdepth 
across 8 columns was printed: 


WAIT FOR INSTRUCTIONS BEFORE ANSWERING THESE 
QUESTIONS 


And in three divisions across the page were set: 





Do you believe that you have normal vision or corrected vision with 
glasses? 
Yes No 
If not, what is the nature of your eye defect?...................... 





Which of the above columns seemed easiest for you to read? 
Column No. ........ 
Why did it appear the easiest to read?................. 000 cee eeeee 


Oe ee ee 
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Each of the eight columns across the page were divided by 
column rules in newspaper fashion. Each newspaper column 
was divided into two 8-inch columns of reading matter headed 


Column Column 
1 2 


etc., in approximately a ?-inch space, below which appeared 
reading matter, separated by a hair line rule. In this manner 
all reading matter was separated. Columns | to 8, inclusive, 
appeared on the upper half of the page and columns 9 to 16, 
inclusive, on the lower half. 

The length of each line was 12} ems (2;'5 inches) butted next 
to a double bevel hair line rule with a 6 point base, leaving a 
margin of approximately 3 points, with the exception of the 
wider margin on the outside of columns 1, 8, 9 and 16. The 
characters adjacent to either margin were flush against the 
column rule with intervening letter spacings accompanied by the 
band space of the linotype machine. : 

The reading material was set in the following type sizes: 





COLUMN GROUP TEST A GROUP TEST B AND C 





6} on 7 8 ong 
64 on 7 6 on7 
73 on7 7 on8 
6 on7 64 on 7 
63 on 7 6 on6 
63 on 6} 62 on 7} 
6} on 63 8 on8 
6 on 6 63 on 7 
8 on8 64 on 6} 
62 on 7} 6} on 6} 
64 on 7} 63 on 73 
7 on 7} 8 on 8} 
7 on8 7 on7 
8 on9 63 on 7 
8 on 8} 7 on 7} 
63 on 72 64 on 7} 


Explanation: 63 on 7, refers to 6} point Ideal type on a 7 point base, 
or leaded } point; 7 on 7 refers to the size of type on the same base with 
no leading. 


omnour WwW 




















IS a a 








612 HOWARD T. HOVDE 


The point measurement used in this experiment is a modifica- 
tion of the French System which was adopted by the United 
States Type Founders’ Association in 1886. As 996 points was 
the nearest metric measure of 35 centimeters, the point measure- 
ment in inches is mathematically .0138648 inches, usually 
spoken of as approximately 7; of aninch. The equivalents of 
the type sizes used in the experiment and defined by the 
American Type Founders’ Association are: 


Cereal iiss, digits casks ob do che data HRs ts Os 0.083 inch 
EE Eins Ad yn asuscevessenokah ahmeiundieniele 0.09683 inch 
ALIAS. Jn we on cne uabs satan ahah nina 0.1106 inch 
TALIM Phin es0 5s bb oe 0s 40s ababbas Seeyept 0.1245 inch 


However, the measurement used on the Mergenthaler Linotype 
machines which were used in setting this material in the Bulletin 
composing room, are as follows: 


Sodas b-obebis dS ath dilete dba whe: Aas weaeh dbs 0.084 inch 
Ns it, rare RRR S Mhuihies 4am mae ode hewn a 0.091 inch 
i 1 hie. Setecacne ssn stiukcne ss reesked son eee 0.0945 inch 
oe) Sane See wie oe Dery opie ere eee ree Pe 0.098 inch 
EE is hin asch eran tiem onile ate pail < 0.112 inch 
RRR ER Pet SADT Ete parece aN yR® Maer pas 0.126 inch 


The designation of Group Tests A, B and C is used for con- 
venience in reference to both test subjects and material. Each 
group test contains an equal number of subjects participating 
in the experiment. Group Test A represents the original 
reading material set in type sequence of random choice. In 
Group Test B the type setting of reading material has been 
reversed. This was accomplished by reversing extremes of the 
reading rate after the results of Group Test A had been secured. 
Rank order 1 of the average reading rate was set in the type 
setting of rank order 16, and so on until rank order 8 was 
changed with rank order 9. Group Test Cisidentical with Group 
Test B except for a difference in subjects and point of time in 
which the test was conducted. The reading material in Group 
Tests A, B and C is the same throughout the tests inasmuch as 
the order of reading for each column and the context for each 
column has been held constant. 
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From the original page form of the type setting a dry mat 
was made, and in turn a stereotype was cast which printed on a 
high speed press. The ink was Charles E. Johnson’s black 
High Speed News Ink, and the paper grade was blue white 
newsprint of a 32 pound base. The same material was printed 
on both sides of the paper in order to produce the similar 
grayness of a newspaper page. 


SUBJECTS FOR EXPERIMENT 


Three groups of 100 individuals each took part in this experi- 
ment. The performance of these groups are designated under 
the headings, Group Tests A, B and C. The subjects were 
male® college students in the Sophomore and Junior years, all 
students or prospective students in an Advertising course at the 
Wharton School of Finance and Commerce, University of 
Pennsylvania. The students whose tests were recorded were 
naive relative to typographical information. Those who were 
tested in the course in advertising had not at the time of the 
test studied typography. 

By using groups of 100 individuals, it was expected that the 
variation of individual differences and errors (both physical 
and temperamental) would be cancelled by the law of average 
and that the result would present an accurate picture of the 
ordinary reader. Physiological habits in reading, such as the 
perceptual span, the fixation pause, eye movements, refixations, 
the return sweep and inner speech, were considered as constant 
factors that would be transmitted with equal weight to each of 
the columns that were read by the individual subject. Results 
from individuals who knew that they had defective eyesight and 
who lacked corrected vision by use of glasses, were discarded. 

Every student had been admitted to the University by means 
of a psychological test or the Scholastic Aptitude Test so that 
normal intelligence may be presumed. While the intelligence 
of the group may be considered higher than the average news- 
paper reader, the known intelligence of this group permitted a 


* Brooks (6) states that in silent reading sex differences are not 
marked. 
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better check on the accuracy of mature reading than would be 
possible if a wider range of intelligence were present. Only the 
results of native-born English reading students were accepted. 


CONDITIONS OF TESTING 


The experiment was conducted over a period of two college 
years. Group Test A was made in the spring months of 1928 
at the close of one college year, and Group Tests B and C were 
made in the fall months of 1928 at the beginning of a college 
year. The experiment was held during a classroom hour of 
50 minutes. Sixty seconds was the allotted reading time to each 
column with a greater rest period between readings to relieve 
fatigue. 

The reading took place between 8 o’clock in the morning and 
4 o’clock in the afternoon, with the bulk of the reading appearing 
nearer noonday. Natural daylight was used which was 
reinforced by electric ceiling lights. Walls and ceilings of the 
rooms were painted cream. It is believed that the illumination 
approximated the reading conditions in which the average 
newspaper is read. 

Typical reading conditions were present. It was expected 
that each subject would read naturally and in his normal 
manner. Instructions were repeated three times in order that 
there be no misunderstanding. Personal comfort was extended 
to the subject in permitting any reading position that was 
natural. A large arm rest upon each chair permitted ease of 
writing. The paper was held in the manner in which the 
reader customarily accommodated his vision to the page. 

Silent reading was followed throughout. The procedure 
emphasized the fact that it was not a speed test and that 
meaningful reading must take place. Caution was exercised 
throughout the experiment toward this end. The group 
instructions were given under the heading of Procedure incor- 
porates the test method. 


PROCEDURE 


The test reading was undertaken in sections of ten to fifteen 
individuals. The results of each individual were combined 
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into Group Tests A, B and C as previously indicated. The size 
of the section was small enough to facilitate careful direction of 
each individual so that the instructions did not miscarry. 
None of the individuals expected a test during the hour in which 
it was given and great care was exerted in order to avoid the 
appearance of a competitive test. The following instructions 
were given: 


“I am going to ask you to do a little reading today. I have here 
excerpts from Lindbergh’s story ‘We.’ You will find that the reading 
is interesting, but I do not want you to consider it as a test since I am 
not concerned with your individual ability but with the average ability 
of a large group of individuals. Please follow my instructions im- 
plicitly. At the outset I am going to ask you to take alternative seats. 
You will find this more comfortable as you will not be crowded by your 
neighbor. Furthermore, I must ask you not to look at your neighbor’s 
paper at any time during the period in which we shall read the articies 
which I have had specially printed. You might consciously or uncon- 
sciously enter into a competition with him. However, at the end of the 
period I shall give you an opportunity to make comparisons if you wish.”’ 

(At this point the test papers were held up to show the group.) 

‘On this page are sixteen columns, each containing a different excerpt 
of Lindbergh’s story ‘We.’ Wait for instructions before reading any 
column. I am going to ask you to read each column normally as you 
would read a newspaper, but be sure you read for content. 

“The reading instructions for each column will be given like this: 
‘Get ready to read column 1; Ready; Read!’ These instructions corre- 
spond to the instructions given a track athlete, but remember you are 
not running a race and I want you to read normally and for content. 
The instructions are so given that you will have the proper attitude 
and a similar attitude before reading each column. 

‘At the word ‘Read’ you will start to read normally and for content. 
In order that I may be sure that you have read for content, I have 
inserted the words ‘‘(Check mark)’’ in parenthesis within the columns. 
(At this point the words (Check mark) are placed on the blackboard. 
These words have nothing to do with the reading matter and may appear 
anywhere within a sentence, paragraph or column. Whenever you see 
these words, put a ‘‘check mark”’ (,/) through the words in this man- 
ner. (Here a check mark (,/) was placed through the words on the 
blackboard. ) 

‘After following this instruction, continue to read until I say: ‘Stop.’ 
Put a cross through the last word read. (Here a cross (<) was placed 
on the blackboard.) Be sure you put a cross through the last word read, 
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whether this word is at the first of a sentence, the middle of a sentence, 
or at the end of a sentence.’’ 

‘‘When this is done, be sure to look up and away from the paper. By 
no means continue to read. If you are interested in the story, I shall 
give you an opportunity to come back to it later. I want you to look 
away from the paper toward the front of the room or out of the window. 
I ask you todo this as relaxation. If you raise your arm once, you suffer 
no fatigue, but if you raise your arm ten or more times, you may notice 
it. Similarly you may not notice eye fatigue in reading a short time, 
but I want to make sure that you read each column under the same 
circumstances, so please look away as soon as you place a cross through 
the last wordread. Ishall then ask members of the class what they have 
read.”’ 

(At this point the papers were distributed to the group.) 

‘Please do not look at the paper that Iam giving you. It is printed 
the same on either side of the sheet, but do not look at it or fill out 
anything until I give you further instructions. Remember, you have 
nothing to gain by trying to look at the paper ahead of instructions, so 
please curb your curiosity. If you do look, it is like cheating in solitaire 
—there is no point to it.”’ 

After the papers were distributed, the substance of the foregoing 
instructions was repeated and questions were asked in order to clear 
up any vague point. Again the instructions were repeated for the third 
time: 

“‘Let me repeat briefly. You are going to read column 1 in this man- 
ner. I shall say: ‘Get ready to read Column1; Ready? Read!’—at 
which time you will start reading, being sure that you read normally 
and for content. When you see the word (Check Mark), follow the 
instructions (this is emphasized by pointing to the blackboard where 
the checkmark (./) appears through the words.) This done, continue 
to read until I say ‘Stop.’ Put a cross through the last word read. 
Are there any questions? 

‘*There is one thing I might add. The time given you to read is so 
regulated that I do not expect the fastest reader of this group to finish 
the column, but should I be mistaken, will you note the fact that you 
have read the column in less than the allotted time. Should this be the 
case, of course do not read into the next column. 

‘Are the instructions clear?”’ 

“Get ready to read Column 1; Ready? Read!” 


The stop watch was pressed simultaneously with the word 
“Read.”’ During the sixty second reading interval, I watched 
carefully the individuals who were reading. Distractions were 
noted and a caution was given at the end of the reading. In 
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the case of an individual who had a severe cold and who was 
forced to take ten or fifteen seconds out of one reading period in 
order to clear his head, his results were discarded. 

At the end of the sixty second reading period, I was insistent 
that the instructions were followed faithfully. Reading 
stopped and the individuals all looked away from their papers. 

I then asked: “Mr. Blank, where was Lindbergh’s father 
born? Mr. So and So, give the incident described in this 
column.” If evidence was found that the reading was faulty, 
the result was discarded. I then looked at each paper to see 
that the check mark was properly made and asked for questions 
on the procedure. 

Before reading Column 2, the group was again cautioned that 
they should read normally as they would read at home without 
these conditions being imposed upon them. 

The rest period between columns was not timed, but as the 
test took the full class hour, the rest period always exceeded the 
reading period. The remaining columns were read under the 
standard conditions. At the end of each reading the questions 
varied according to content and were also varied in the manner 
asked. Thus a question might be asked: “The name of 
Lindbergh’s friend was: Smith, Lynch, Custer. Which was 
it?’”’ These names had appeared in the reading, but Custer was 
a battlefield and Lynch was Lindbergh’s friend. Again, 
“What type of aeroplane was used?” ‘Through which states 
did Lindbergh pass?” or “In what town did Lindbergh stop?” 
These specific questions were reinforced by a further statement 
of the incident described in each column. 

At the completion of the reading of the sixteenth column, the 
individuals filled in the personal data relative to their age and 
the nature of their vision as they knew it, and made a judgment 
of which column seemed easiest to read and why. No clue to 
this latter information was given to them. 

At the end, the papers were collected individually and each 
paper was carefully inspected to see that the instructions had 
been properly filled out. When known eye defects were 
discovered, the results of these individuals were discarded. 
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Furthermore, results of a Chinese and a French Canadian 
student were discarded because English was not their native 
tongue, although from casual observation their results appeared 
to be on a par with the others. 

In obtaining the results, the following additional tests had 
been made, but were not used: 18 were discarded because of 
known eye defects; 18 were tested in the second and third 
experiments whose results had appeared in the first, and these 
results were not included because of the influence of familiarity ; 
23 were discarded due to errors in following instructions or 
reading the allotted column in less than 60 seconds; two were 
foreign-born individuals. Little uniformity was found among 
those who read the allotted material in less than 60 seconds, and 
the faster reading of these individuals probably resulted from 
a competitive spirit, skimming, lack of interest and greater 
interest in material, anticipating the starting signal, and 
similar factors which may be classed, as a whole, as errors in 
following instructions. No one read over half of the sixteen 
columns in less than the allotted time. Of this discarded 
group few overread more than one of the sixteen columns. 
The discarded papers were not tabulated. 


RESULTS AND INTERPRETATION OF DATA 


The 300 individual results were compiled in three groups, 
Group Tests A, B and C. A total of 1,318,343 words were 
read throughout the 4800 separate columns in the combined 
reading time, exclusive of rest periods, of 80 hours. While it is 
possible to include in the tables only the arithmetic means of 
the groups, anyone who may be interested may secure photo- 
static copies of the original data. A study of the individual 
records shows variations from the average but these variations 
are for the most part within the limitations of sampling, and the 
tendency of the reading rate may be well expressed by the 
arithmetic mean. Part I includes the results of the direct 
measurement of the number of words which were read; Part 
II describes the readers’ preferences and opinions of the legibility 
of the type setting. 
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PART I 


Table 1 gives a comparison of the type setting with the 
average number of words read in 60 seconds. The table includes 
Group Test A, B and C, each containing the average results of 
100 readers. Besides the reading rate, the table includes the 
rank of the arithmetic mean, the reading order of the context, 


TABLE 1 
Comparison of type setting with reading rate 





GROUP TEST A GROUP TEST B GROUP TEST C 


i, 





i. 
3 
5. 


258 . 98 
267 .50 
289.51 
256 .63 
251.83 
275 .43 
281.90 
283 .31 
269.17 
302 .32 
282 .28 
268 .07 
251 .36 
262.16 
277 .67 
239.21 


SIZE OF LEADING 
TYPE OF TYPE 


preferences 
Rank order of 
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Reading order 
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Readers’ 
preferences 
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and also (this concerns Part II of the experiment) the readers’ 
preferences as to which type face was judged easiest to read. 

Table 2 contains the same data shown in table 1 with the 
exception that the reading order of the context has been kept 
in sequence and hence is a comparison of context with the 
reading rate. 
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The information contained in tables 3,4 and 5 may be brought 
forward as evidence of the reliability of the arithmetic mean. 
Table 3 gives the means of the reading rates for each of the 
sixteen reading samples in Group Test A. It gives also the 
standard deviation of each sample and the upper and lower 
limits of the range in standard deviation on either side of the 


TABLE 2 
Comparison of context with reading rate 

















GROUP TEST A GROUP TEST B GROUP TEST C 

moi 2 Sais $ Sa|s by |Sels A 
ce $25 | 48] ta | o)G8y lal] ie] o/G8y lad] ta| | 
wum- | Ze®| 5. | Ye 2) fe2|5.| ¥el|e8| 22%/ 5" | we ee 
ven | “Ss | 55 | 28 | $5 | “Es | 24/58 | S| “Ee | 24/58/88 
pbs | $5 | Fs | $5 | see $5 |as|e8| :82|25| os| e8 

° S e |< |e je |e |< |e |e le 

1 (265.14 14| 1] 3 |239.21/ 16] 1 | 30 [238.65 16| 1] 30 
2 |285.96 6| 2| — 267.50; 10| 2| 1 \273.22} 8| 2| — 
3 |272.85| 13| 3] 2 |251.36/15| 3| 7 \263.7613| 3| 11 
4 274.18} 11} 4| 1 (256.631 13] 4] — |263.1614| 4] 1 
5 |273.241 12} 5| — \258.981 12] 5| — \264.89\ 12] 5] — 
6 278.47] 8| 6| — \269.17| 8| 6| 2 \281.19) 4] 6| 8 
7 |261.96 16} 7| — \262.16/11| 7| 7 \266.18111| 7| 4 
8 |289.22; 5 8| — |281.90| 5| 8] 2 |287.80' 3; 8) 1 
9 |306.19) 1} 9| 30 |289.51| 2| 9] 4 |290.02) 2| 9/ 1 
10 |277.15| 9} 10] 1 275.43} 7| 10| — |272.67} 9|10| 1 
11 |302.47, 2] 11| 2 |302.32} 1 | 11 | 10 |305.29) 1 | 11 | 10 
12 (282.84 7)| 12| — |277.67| 6 | 12 | 32 |277.12| 6 | 12] 24 
13 |290.85| 4] 13] 11 \282.28) 4|13| 5 j280.61| 5|13| 5 
14 |292.941 3] 14] 32 283.31} 3| 14| — \277.11| 7] 14] 1 
15 |277.02} 10| 15] 13 |268.07|} 9| 15 | — |270.29| 10 | 15 | — 
16 |264.28) 15] 16] 5 |251.83| 14| 16 | — |259.38| 15| 16| 3 









































mean. In normal distribution 68 per cent of the cases will 
fall within a range of one standard deviation above or below 
the arithmetic mean. An examination of the seventh column 
of the table shows that in the sixteen samples from 62 to 70 
per cent of the total cases fall within this range. The variations 
in the percentage of cases within the range of one standara 
deviation above or below the mean may be explained in terms 
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of the probable error of the several standard deviations. 
Furthermore a measure of skewness by the position of averages 
method showed a very small amount of assymetry. The 
maximal amount for any sample was -8 per cent. Hence, 
while this is not a complete test for normality it may be assumed 


TABLE 3 
Reliability of data 
Group Test A 














PER CENT 
TOTAL 
CASES 
INCLUDED 
READING ARITH. 3.D A.A. — A.A. + COEF. OF WITHIN 
COLUMN MEAN* aie 18.D.* 18.D.* VAR. RANGE OF 
18.D. on 
EITHER 
SIDE OF 
MEAN 
1 265 55.44 | 210 320 20.9 69 
2 286 51.60 234 338 18.0 61 
3 273 45 .26 228 318 16.6 62 
4 274 50.85 223 325 18.5 71 
5 273 43 .28 230 316 15.9 64 
6 278 50.99 227 329 18.3 67 
7 262 44.03 218 306 16.8 67 
8 289 57 .87 231 347 20.0 70 
9 306 53.94 252 360 17.6 62 
10 277 56.47 221 333 20.4 67 
ll 302 54.71 247 357 18.1 69 
12 283 59.13 224 342 20.9 68 
13 291 49.19 242 340 16.9 70 
14 293 51.31 242 344 17.5 68 
15 277 50.73 226 328 18.3 65 
16 264 49.17 215 313 18.6 69 

















* Decimal point omitted and fraction of 0.5 or more included as whole 
number. 


that the distribution of the sixteen samples were approximately 
normal and that the variations from the average were those that 
could be expected in simple sampling. For the benefit of those 
who may be interested the coefficient of variation is given in the 
sixth column of the table. Tables 4 and 5 give the same infor- 
mation for Group Tests B and C. 
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Table 6 gives the correlations between the various tests by 
the Pearsonian coefficient formula. The correlations are all 
high. Group Test A represents the first test. Because of 
the possible influence of context, despite the fact that the 
material was carefully chosen, the type setting was reversed 


TABLE 4 
Reliability of data 
Group Test B 








PER CENT 
TOTAL 
CASES 
INCLUDED 
READING ARITH. $.D A.A. — A.A. + COEF. OF WITHIN 
COLUMN MEAN* pie 18.D* 18.D.* VAR. RANGE OF 
18.D. on 
EITHER 
BIDE OF 
MEAN 
1 239 50.25 189 289 21.0 67 
2 268 46.78 221 315 17.5 65 
3 251 43.12 208 294 17.1 68 
4 257 45 .02 212 302 17.5 71 
5 259 47.77 211 307 18.4 68 
6 269 54.03 215 323 20.1 67 
7 262 43 .46 219 305 16.6 62 
8 282 57.18 225 339 20.3 66 
9 290 52.58 237 343 18.1 66 
10 275 64.14 211 339 23.3 66 
ll 302 61.36 241 363 20.3 70 
12 278 61.04 217 339 21.9 64 
13 282 53.62 228 336 19.0 73 
14 283 60.47 223 343 21.4 70 
15 268 56.02 212 324 20.9 77 
16 252 47 .42 205 299 18.8 74 























* Decimal point omitted and fraction of 0.5 or more included as whole 
number. 


for Group Test B and C in proportion to the extremes of the 
reading rate. This is equivalent to inverting the context with 
respect to the original type setting. In Group Test A, 
Column 9, set in 8 point type on an 8 point base, ranked first, 
and Column 7, set in 63 point type on a 63 point base, ranked 
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sixteenth. In Group Test B, Column 9 was set 63 on 63, and 
Column 7 was set 8 on 8. This change was subsequently 
followed by the reverse setting of Columns 2 and 14, 3 and 13, 
4 and 12 until each column was completely changed to a differ- 
ent type size or leading. Group Test B and C represent the 
same material read by different individuals. 


TABLE 5 
Reliability of data 
Group Test C 





PER CENT 





TOTAL 
CASES 

INCLUDED 

READING ARITH. 8.D A.A. — A.A. + COEF. OF WITHIN 

COLUMN MEAN* apie 18.D.* 18.D.* VAR. RANGE OF 

18.D. on 

EITHER 

SIDE OF 

MEAN-. 
1 239 63 .50 175 303 26.6 66 
2 273 65.11 208 338 23.8 59 
5 264 56.72 207 321 21.5 64 
4 263 57 .02 206 320 21.7 72 
5 265 61.11 204 326 23.1 66 
6 281 61.86 219 343 22.0 64 
7 266 54.30 212 320 20.4 69 
8 288 73.40 215 361 25.5 66 
9 290 63.61 226 354 21.9 70 
10 273 70.14 203 343 25.7 64 
11 305 62.51 242 368 20.5 64 
12 277 68.8 208 346 24.8 68 
13 281 62 .32 219 343 22 .2 68 
14 277 66.36 211 343 24.0 67 
15 270 63.11 207 333 23.4 70 
16 259 61.55 197 321 24.4 72 























* Decimal point omitted and fraction of 0.5 or more included as whole 
number. 


Group Tests B and C were performed under identical condi- 
tions except as to point of time when the tests were made. 
With the exception of the extremes in the reading rates Group 
Tests B and C vary within the limits of simple sampling. 











624 HOWARD T. HOVDE 


According to the independence condition of sampling, there 
should be no correlation between the results of the two tests. 
The coefficient of correlation is, however, 95 per cent, ranked 
either according to the size of type or order of context. Hence 
we must conclude that there is some association between the 
two tests. There are two possible causes of relationship: 
(a) Variation of type setting, (b) Variations of context. 

In Group Tests A and C, the context was held constant and 
the order of type setting was inverted. Under these conditions 
74 per cent direct correlation was found between the tests. 


TABLE 6 
Group test correlations 





Comparison of Type Setting with Reading Rate 
Data from table 1 


) A and B = —84.2 

Correlations between Group Tests > A and C = —79.8 
B and C = +95.0 

Comparison of Context with Reading Rate 
Data from table 2 

A and B = +90.5 

Correlations between Group Tests > A and C = +74.0 
B and C = +95.0 





Correlations were computed from the mean by use of the Pearsonian 
coefficient formula. 


Inverting the order of context and holding the order of type 
setting constant we find 79.8 per cent inverse correlation. 
Since inverting the order of context has changed a high positive 
correlation to an equally high negative correlation, it follows 
that the order of context is the dominant characteristic in 
determining the association between the two tests. 

The conditions for Group Tests A and B, and A and C, are 
the same except as to point of time. We find the conclusions 
reached by comparing Group Tests A and C to be substantiated 
by a comparison of Group Tests A and B. With order of 
context held constant and order of type setting varied we have 
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90.5 per cent direct correlation. Inverting the order of context 
and holding the order of the type setting constant we find 84.2 
per cent inverse correlation. Again it follows that the dominant 
characteristic is order of context. 


TABLE 7 


Ratio of the actual differences of the mean of each sample from the mean of 
all the samples to the standard error of the differences 











RANK ORDER OF D/S.E. of Dif. 
ARITH. MEANS 
Group Test A Group Test B Group Test C 
1 3.3 3.9 3.6 
2 2.7 2.6 1.9 
3 1.6 1.6 1.5 
4 1.4 1.6 9 
5 1.0 1.5 9 
6 Pe 1.0 4 
7 3 6 A 
8 A Pe .0 
9 5 3 .0 
10 5 3 3 
ll 1.0 1.1 8 
12 1.2 1.5 9 
13 1.2 1.8 1.0 
14 2.1 2.5 1.2 
15 2.4 2.7 1.6 
16 2.8 4.1 3.7 














Computed from formula on the reliability of the difference in terms 
of the standard error of the difference. 

It is usually customary to take D/S.E. of Diff. of 3 as indicative of 
complete reliability. See ‘“Statistes in Psychology and Education” 
by Henry E. Garrett. 


The method by which the experiment was conducted pre- 
cludes the possibility of measuring the general relationship 
between the rate of reading and the type setting. The close 
correspondence between the positive correlation on the one hand 
and the negative correlation on the other, when the order of the 
context is inverted, argues fairly conclusively that no general 
association exists between rate of reading and the type setting. 
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This fact makes it necessary to turn to an investigation of the 
variations in the rate of reading for the individual samples. 

In Group Tests A, B and C an examination of the variation 
in the rate of reading of each sample from the average rate of the 
16 samples (table 7) shows twelve cases in which the actual 
differences were sufficiently in excess of the standard error of 
the differences to be significant. A further investigation (table 
8) indicates that these significant differences are associated 
with the same context. Thus the context of the reading 
columns 9 and 11 gives reading rates outside the limits of 
simple sampling in all three group tests. This may be explained 











TABLE 8 
Significant differences in extreme samples 
GROUP TEST A GROUP TEST B GROUP TEST C 
ee Bee eek ls 1 
MEAN 3S f.-: rc) fi: S fi.- 
ah | f/e8| sf | s |e8| 28 | @ les 
B 561A Ba 6 1a a 61a 
1 8 on8 9 | 3.3 | 620n72| 11 | 3.9 | 630n7 11 | 3.6 
2 640n7}| 11 | 2.7 | 640n6} 9 | 2.6 | 640n6} 9/|1.9 
15 | 62on7?| 16| 2.4] 7 on8 3|2.7| 60n74| 16] 1.6 
16 64 on 6} 7|2.818 on9 1 | 4.1} 8 on9 1 | 3.7 
































by the fact that these columns contained slight elements of 
humor and suspense, respectively, which give them exceptional 
interest value. The reading material in columns 1, 3, 7 and 
16 was descriptive in nature, both historical and factual, but 
the fae¢tors which have caused these differences are not suffi- 
ciently in evidence to be determined. Likewise in the other 
columns no conclusion can be drawn from the relative interest 
or reading difficulty of the context. 

Of the variables, type setting and context, context is of 
relatively greater importance than type setting. But as only 
one column is in perfect agreement among the three tests and 
that only as to rank order, which may be accidental, one may 














EFFECTS OF TYPE, LEADING AND CONTEXT 627 


inquire further as to the differences. The actual difference of 
the number of words read between the most read and least 
read columns gives this contrast: 











GROUP GROUP GROUP 

TEST A TEST B TEST C 
mete 8. crite ike dade aS 306.19 | 302.32 | 305.29 
RE ea ee ee eee Sk 261.96 | 239.21 | 238.65 
ey IIS... cceccceuscs cancion 44.23 63.11 66.64 














In reality this comparison only shows the similarity between 
the tests which the correlations already noted. However, it 
may give some indication of differences within the group. 
The average age of Group Test A is 20.55 years, Group Test 
B, 20.21 years, and Group Test C, 19.47 years. Also, Group 
Test A was given in the spring of the year and the other tests 
were given in the fall. The total number of words read through- 
out all columns is: Group Test A—449,476; Group Test B— 
431,733; Group Test C — 437,134. This factor indicates 
something other than the relative maturity of the subjects, 
as it is not coincident with it. The difference will be con- 
sidered later under the general discussion of the experiment. 

Possibly an interesting result, though shedding no light on 
the matter of size of type and leading as a factor of legibility, 
is found in the two columns set in 63 on 7. This duplication 
was originally inserted as a checking factor, being used in 
Group Test A in Column 1 and 5 where Column 1 was thought 
to be necessary as a “warming up” column. However, when 
the context was believed to be an important influence, the 
setting for the subsequent tests were reversed and the “warming 
up” column eliminated. Taken from Table Nunber I is the 
following comparison: 








SIZE GROUP TEST A GROUP TEST B GROUP TEST C 
6} on 7 265.14 (14) 1 281.90 (5) 8 287.80 (3) 8 
6} on 7 273.24 (12).5 283.31 (3) 14 277.11 (7) 14 











Word difference 8.10 2.41 10.69 
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No significance can be attached to the above information 
since it has been shown that the influence of context has 
permeated throughout the experiment. The word differences 
might be considered as some indication of the relative difference 
in context among columns 1, 5, 8 and 14. However, this 
information serves no purpose in determining the relative 
value of size and leading for the experiment as a whole. 

How futile this becomes is shown in these subsequent tables: 


Relationship of type size, based on rank order 








SIZE OF TYPE GROUP TEST A GROUP TEST B GROUP TEST C 
6 on 6 5 12 12 
6} on 6} 16 2 2 
63 on 63 8 7 9 
7 on7 13 5 5 
8 on8 1 ll 11 














It has generally been assumed by those who work with type 
that legibility is directly proportionate to the size and leading, 
within limits. In this experiment the reversal of the type 
setting in Group Tests B and C from Group Test A is equivalent 
to inverting the context with respect to the original type setting. 
The facts do not show a proportionate increase in legibility as 
the type size increases but the reading rate appears to be 
influenced entirely by context. 

In regard to leading, this table shows a similar influence: 


Relationship of leading 1 point, based on rank order 








SIZE AND LEADING GROUP TEST A GROUP TEST B GROUP TrSsT c 
6 on7 ll -— 10 + 8 + 
64 on 74 2+ 14 — 15 — 
62 on 72 15 — 1 + 1 + 
7 on8 4+ 15 — 13 — 

8 on9 3 - 16 — 16 — 

















For convenience of interpretaton, the plus and minus 
signs indicate improvement and retrogression in the rank order 
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when 1 point leading was added. Only two out of the five cases 
show any improvement with leading, and if it were not for the 
context factor, it might be concluded that leading is of little or 
negative value in regard to legibility. It is evident that there 
is not only a lack of agreement in the influence of type sizes, 
but also there is a lack of agreement in the influence of leading. 

In five columns, the same type size appears either on the 
same base or leaded from } point to 1 point. The effect of 
leading appears in tabular form below: 


Relationship of leading same type face, based on rank order 





SIZE AND LEADING GROUP TEST A GROUP TEST B GROUP TEST C 





62 on 63 8 
63 on 7 14 
63 on 7 12 
63 on 7} 9 
6} on 7} 15 














The few cases of the same single type size with leading do not 
warrant a separate statistical correlation as the few items will 
result in a large probable error. With one exception the effect 
of leading has inverted the order of the results of Group Test A, 
when the context was changed in Group Test B and C. Ifa 
similar comparison is taken from the entire experiment, the 
effect of leading as a whole over 16 columns of all three tests, 
13 examples are found where leading has aided legibility and 
20 where it has retarded the reading rate. These figures are 
cited only generally as no conclusions can be drawn from them 
since we have previously demonstrated the dominant influence 
of context. 


CONTINUATION 


For convenience in publication, it has been necessary to 
divide the paper at this point. For the purpose of continuity, 
it may be noted that Part II deals with the reader’s prefer- 
ences and opinions of legibility in contrast with the criterion 
of the reading rate. The discussion of both Parts I and II 
along with the general conclusions and bibliography must be 
left to the next issue of the Journal. 











NOTE ON THE COMPARATIVE VALIDITIES OF 
JUDGMENTS OF INTELLIGENCE BASED ON 
PHOTOGRAPHS AND ON INTERVIEWS 


ETHEL MORIWAKI 


Territorial Normal and Training School, Honolulu Hawaii 


The subjects used in this study were seven men and eight women 
students of the Territorial Normal School, Honolulu. Their ages 
ranged from eighteen to twenty-one years. They were specially se- 
lected to represent the full range of intelligence found in this institution, 
being chosen at regular intervals of five score points on the Thorndike 
Intelligence Examination. 

The judges consisted of four prominent educators of Hawaii, the 
Assistant Director of the Territorial Division of Research, the Principal 
of the Experimental School, the First Grade Supervisor of the Normal 
Training School and the Director of Teacher Training of this 
Institution. 

The photographs were all taken by the same person with the same 
camera in the same room, and were front views from head to bust. They 
were arranged alphabetically for presentation to the judges. Each 
judge ranked all the photographs without consultation. 

Two weeks after the photographs were examined and judged, the 
fifteen subjects were asked to present themselves individually in a class- 
room for a personal interview with the judges. Each one was asked 
questions and given an opportunity to express himself in speech for 
about two minutes. At the end of the interview, each judge recorded 
his impressions of the subject’s intelligence without conferring with the 
others. At the close of the interviews each judge ranked the subjects. 

The average school grade for the first two quarters was computed for 
each subject. 

Correlations were computed by the Spearman rank-difference for- 
mula. These correlations are given in the accompanying table. The 
four judges are designated A, B, C and D when judgments of the photo- 
graphs are under consideration, and A’, B’, C’ and D’ when considering 
interviews. The total judgments of the last two columns were obtained 
by summing the four ranks for each subject and ranking these sums. 
(See table 1.) 

From the table we find that the average correlation between Thorn- 
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dike score and judgments based on photographs is .28; between Thorn- 
dike score and judgments based on interviews, .56; between average 
grade and judgments based on photographs, .45; between average 
grade and judgments based on interviews, .44; and between judgments 
based on photographs and judgments based on interviews, .49. The 
average intercorrelation between judgments based on photographs is 
.48; between judgments based on interviews, .59; and between one set 
of judgments based on photogrpahs and another based on interviews 
(exclusive of the four above noted in which the same judge made both 
judgments), .29. 


TABLE 1 
Coefficients of correlations 












































PHOTOGRAPHS INTERVIEWS —— pony 
GRADE MENT = 
OF 

A |B |C]|D/|A’| B’ | C’| D’ |pHoros| “TER 

Thorndike.....| .79 | .40) .22) .36) .15) .51] .70) .45] .58) .41 63 | 

Ce cect .56) .42) .41) .39) .32) .55) .42) .46) .45 48 

} pS oP yt what 39] .58| .24|_.57]_.32) .19) .63| .70| .43 

eter rhe eaeney. .67) .48) .« -40, .16| .46) .72 42 

tA aba O 51) .40) .16 .35| .76 .35 

Ee ae .13} .08; .15} .69) .66 .16 

Blin. ss euas 64| .45| .85| .51| .87 

Bd a thd oy cca en 51; .77; .30 .77 

tbs ableeas .34 .18 .62 

a ey ee .52 .90 

Bese dgeeeen .38 
Wet. dot bed 






































The significance of these results may be gauged by the fact that with 
a sample of 15 drawn from an uncorrelated population, p’s as high as 
.28 would arise about once in six trials as a matter of chance, as high as 
.52 about once in 40 trials, and as high as .62 about once in 160 trials. 
The probability that 45 such correlations would all be positive, however, 
is practically zero. 

Hence we may conclude that judgments of intelligence based on 
photographs are definitely though slightly better than chance; while 
judgments based on interviews are noticeably better, and in fact seem 
to have here some real validity in separating individuals over a wide 
range of intelligence. 
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A COMPARATIVE STUDY OF PSYCHOGALVANIC AND 
ASSOCIATION TIME MEASURES 


A New PsycHoGALvANic APPARATUS 


STARKE ROSECRANS HATHAWAY! 
Ohio University 


INTRODUCTORY 


The present paper is divided into three parts. Part One isa 
statement of the problem and an account of the development 
and final form of the apparatus. Part Two is devoted to some 
preliminary findings with the psychogalvanic apparatus com- 
paring reaction times to association word stimuli with reactions 
obtained by means of this apparatus. Part Three is a general 
summary with some suggestions as to method of procedure in 
the use of the psychogalvanic apparatus. 


THE APPARATUS 


Some four years ago with the idea of studying further the 
possibilities of the psychogalvanic reflex the apparatus for this 
purpose described by Wechsler (9) was set up. The findings of 
our preliminary studies with this apparatus seemed to point 
to more thorough investigation. Such study was not feasible 
because of certain difficulties with the method of obtaining and 
recording the responses. Our main problem, therefore, became 
that of an attempt to improve the apparatus. 


1 The author wishes to express here his especial gratitude to Dr. 
James P. Porter particularly whose invaluable interest and criticism 
made the work possible; to Paul Stocker whose early advice and help 
laid the foundation for the technical development of the apparatus; 
to H. P. Longstaff and others on the Ohio University staff who have 
been personally interested from the first and whose interest and sug- 
gestions have meant much. 


632 











PSYCHOGALVANIC AND ASSOCIATION TIME MEASURES 633 


The particular problems to be met were: first, polarization 
of the electrodes from the use of direct current made necessary 
the use of wet or non-polarizing electrodes, thus slowing up 
the work. The use of a delicate d’Arsonval galvanometer 
made transportation and setting up a distinctly difficult task. 

The first point of attack was the problem of polarization. 
It was of course recognized that if an alternating current of 
sufficiently high frequency could be used this difficulty would 
practically disappear. Work by Galler (10) and Prideaux (7) 
tended to show that the response could be obtained by the use 
only of a direct current. Galler used a “pulzenlamp” giving 
several thousand cycles per second for the extrinsic current and 
rectified this current after it had passed through the electrodes. 
Prideaux used a current of 5000 cycles. Both succeeded in 
eliminating polarization but failed to get responses. It occurred. 
to the writer that these experiments would bear repeating with 
a somewhat lower frequency. 

Accordingly a double cyclometer was built and applied to 
the Wechsler hook-up in such a way that the first cyclometer 
changed the direct current from the battery into an alternating 
current for the bridge and electrodes. The second cyclometer 
was synchronized with the first and gave this alternating cur- 
rent out again as direct current for the galvanometer which of 
course could use only direct. The double cyclometer was 
driven so that about 40 cycles were obtained. To understand 
this thoroughly the reader should trace carefully through 
figure 1. 

With this arrangement it was found that as expected there 
was a minimum of polarization and more important the re- 
sponses were just as strong as with the direct current. This 
opened the field for further improvement. The cyclometers 
were noisy and tended to get out of adjustment. 

In considering other possible sources of alternating current 
the ordinary 60 cycle lighting circuit was quite logically the 
first possibility. This if used would need rectification. The 
most feasible method for this was the three-element vacuum 
tube. It was immediately found that if the electrodes were 
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placed in the grid circuit with the tube arranged in the usual 
way and that if the galvanometer were placed in the plate 
circuit an alternating potential of about six volts applied to the 
grid through the electrodes would show appreciable responses 
in the galvanometer readings. The discovery of this funda- 
mental circuit led logically to further steps toward greater 
efficiency. The first move was to put a transformer in the grid 





Fig. 1 


circuit in such a way that the electrodes were in the primary and 
the grid with proper C bias was in the secondary circuit. In 
this way it was possible to obtain a pure alternating current for 
the electrodes and to allow the use of dry electrodes without 
fear of polarization. 

It was now clear that the responses were capable of much 
greater amplification. Since current amplification was what 
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was desired this was accomplished by putting two three-element 
tubes in parallel. The amplification was so great, thus obtained, 
that the galvanometer was replaced by an 0-1 milliammeter. 
One added difficulty was here encountered. There was a con- 
stant current of over fifteen times its maximum scale reading 
flowing in the milliammeter circuit. This was overcome by 
running an adjustable counter potential across the milliammeter 
so that the actual current flowing would be nearly zero. The 


Fia. 2 


responses were now read as increments over and above this 
constant counter potential. 

The potential across the electrodes was governed by a po- 
tentiometer which gave a voltage range of 0-30 volts. This 
electrode circuit contained the primary of the transformer 
through which the grids of the tubes were affected. Negative 
grid potential was applied by a C battery at 224 volts. This 
potential as later trials showed may be kept constant for most 
uses. 
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A grid voltmeter was inserted as a means of measuring and 
keeping constant input potential from the electrodes. The 
reading on this was dependent upon: (a) the value of the C 
voltage and (b) the value of the electrode potential. Since 
it was desirable to have on every individual subject tested 
approximately the same electrode current, the second control 
(b) was used, and the voltage was set to a value which de- 
pended upon the combined characteristic curves of the tubes 
used. (The curve for each tube should be nearly the same.) 





Fie. 3 


As the apparatus was finally put together the grid voltmeter 
was eliminated and advantage was taken of the fact that the 
grid ‘current varied almost directly with the grid voltage. A 
double pole double throw switch now served to change the plate 
milliammeter from the plate circuit to the grid circuit in the 
preliminary adjustment of the electrode potential. This acted 
as a substitute for the grid voltmeter. (Fig. 4.) 

The electrodes used were of nickeled copper. Two sets were 
provided. Each electrode of the one set was about 3.5 cm. in 
diameter and was used in case the subject’s hand was dry, 
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excreting little perspiration. The other set was about 1.7 em. 
in diameter and was used on most subjects, or on subjects whose 
hands were particularly moist. When the subject was in the 
circuit having the electrodes bound against the palm of his hand 
the electrode current was adjusted by use of the potentiometer 
until the reading on the milliammeter in the grid circuit was 
.01 milliampere or somewhat less depending upon the sensitiv- 
ity required of the apparatus. 





Fia. 4 


As will be seen from figure 4 the A.C. 226 type tubes were 
lighted by alternating current and this supply as well as the 
alternating current electrode potential was taken from a single 
transformer giving 1.5 volts and 30 volts respectively. It 
was found desirable to put two ballast tubes in the primary 
supply circuit of this transformer so that the variations of line 
current would not intrude to too great a degree. 

In the finished apparatus the batteries, ballast tubes, and 
transformer were mounted in one case and the controls and 
meters in another. Though the former proved somewhat 
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heavy one person could readily carry the complete apparatus. 
It was found that less than one minute was required to set up 
the apparatus ready for adjustment of the electrodes to the 
subject. 

The possibility that the resistance of the subject might be an 
important factor was considered in the construction of the 
apparatus. In view of the negative results from research on 
this problem Darrow (1), Syz (2), and in view of the positive 
fact that the magnitude of the response is proportional to the 
actual current flowing between the electrodes it was decided 
that the most efficient method would be to keep this latter 
current as nearly as possible at a constant value. Accordingly 
the apparatus was provided with an adjustment for this current. 
Approximately the same current was used on all subjects 
tested. 

The box containing the controls was supplied also with bind- 
ing posts, and a shunt control for an external reflecting gal- 
vanometer which would be useful for making photographic 
records and in class demonstrations where it is desired to throw 
a spot of light on a screen so that the class may observe visual 
records of the reactions. 

The apparatus and method above described measures the 
reflex responses very quickly and easily. Large numbers of 
subjects may be tested in a relatively short time. The re- 
sponses have been found to be strong enough to permit of 
carrying them over long communicating wires. The apparatus 
may be placed in one room or building and the electrodes and 
subject in another. In other words the subject may be isolated 
and yet his responses accurately measured. The experi- 
menter is thus more completely in control of the stimuli given 
and of the adequate measurement of the reactions. 


PRELIMINARY FINDINGS WITH THE PSYCHOGALVANIC APPARATUS 
RESPONSES MEASURED BY REACTION TIME AS 
COMPARED WITH P.G.R. MEASUREMENTS 


The findings herein reported formed a part of a larger prob- 
lem which was undertaken at the request of the administrative 























PSYCHOGALVANIC AND ASSOCIATION TIME MEASURES 639 


officers of the university. With this larger problem we are not 
now chiefly concerned. It is possible, however, to show how 
the two measures mentioned above compare and to show the 
effect of diurnal variations on each of these measures. One 
hundred college women served as subjects. Since all of the 
subjects knew the purpose of the experiment the averages given 
below probably are not strictly typical. 

An association list of twenty-five stimulus words was selected 
with two views in mind. First, there were of course certain 
words the use of which was largely determined by the main 
problem. Second, words were selected from the Kent-Rosanoff 
list (5) which were thought to be of particular interest from the 


TABLE 1 
The twenty-five stimulus words used in the order in which they were given~ 





1. Steal 11. Bills 21. Honor 

2. Dark 12. Boy 22. Beautiful 
3. Lie 13. Clever 23. Lock 

4. Wish 14. Home 24. Tree 

5. Dresser 15. Thief 25. Silver 

6. Girl 16. Table 

7. Hide 17. Purse 

8. Trouble 18. Justice 

9. Expel 19. Innocent 
10. Dream 20. Afraid 





standpoint of indicating emotional responses. In addition 
to these several words thought to have little affective value 
were inserted as a means of control. (Table 1.) 

After the electrodes were adjusted the subject was given the 
usual instructions for the association list. Record was kept 
of the reaction time, the emotional reaction (the milliammeter 
reading), and the word which was given as a response. No 
attempt has been made here to qualitatively analyze the word 
responses. From subject to subject the word which came first 
was advanced systematically so that in the one hundred sub- 
jects each word in the list came first four times. Otherwise 
the order was unchanged. A few seconds were allowed between 
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each word and the next to allow the pointer of the milliammeter 
to return to its approximate former position. 

The averages for the words in tenths of a second of the reac- 
tion times and in divisions on the scale on the milliammeter 


TABLE 2 


The average responses for the twenty-five words in tenths of a second and in 
hundredths of a milliampere 























STIM. R.T P.G.R 
ar nik oibideok cis 4 dak £4 Dies eh 0 Ow lee sath 25.6 24.2 
ME oie ad Ueda @knlachs''s he Deg Miah 22.0 21.0 
tate Tc heel Daneh > wane daw enna 6 ake 35.5 25.4 
i il Ry ad au bed ua tiin 6 dole 4b 6 39.6 23.8 
Eis obi Diald co's & 4's. pW wie a kes 22.9 22.1 
Les act Rbaixs Hataatnie Dik aw b Pawns 4000 23 .6 22.9 
Pp ROL. Diode ae tela Pers cocboeecs. 36.1 23 .6 
RAEN wbss 5 mae bbddwe de’: VSR cekS. +: 39.0 27.3 
RR RESO OPE ee 35.2 26.2 
BR DG elite aos in uine  ecede Pee REN 4:8 30.0 24.7 
BR ae as PEs oy cake ca eb Eve ie hes 29.4 23.9 
My AE Sa ge SR Ee Qe ea 23.3 20.7 
Re Fk 5 ok ic idin oe EK ke bs 31.3 22.5 
Ee ee eps ey ee ae ae 7.4 24.3 
i Peaster Siahios eg ww ine Sw ee Oe a ale eo 29.2 27.8 
gt RES I ne 20.8 19.5 
Os Ny Gs Si ss ku ewe SOON ERE ENT oo 23.7 21.7 
DET ME uae s cht Chee koe ek oe eo ee ees 26.9 26.8 
NS S.-i. Satay ch ak wd Cet wees 31.6 24.2 
hs a8 es OG + ins see cwles « 08 30.7 24.7 
EE, Oe RS SO ee 35.6 24.6 
a a er rr one eee 22.6 21.0 
RVR Be apap ep nn eat tas ier emma 22.5 19.2 
So op ne cc Lee ceo ts SA. se ras es 23.0 18.0 
Sr ES SO a PRBS ees 22.4 22.0 
3 are given in table 2. Each P.G.R. unit represents one one- 
Me hundredth of a milliampere. One hundred subjects gave 
4 the measures which make up these averages. 
7 The words ranked according to length of reaction time and 
a according to size of milliammeter response are recorded in 
ih 
ve 
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separate columns in table 3. Longer reaction times and greater 
excursion in the milliammeter are assumed to be measures of 



















TABLE 3 
THE SAME WORDS RANKED ACCORDING TO 
THING TO REACTION TIME WITH THE LONG. | THEIR RESPONSES ON THE PSYCHOGALVANIC 
TIMES AT THE TOP OF THE LIST LARGEST RESPONSES AT THE TOP 
1. Wish 1. *Thief 
2. *Trouble 2. *Trouble 
3. *Hide 3. *Justice 
4. *Honor 4. *Expel 
5. *Lie 5. *Lie 
6. *Expel 6. *Afraid 
7. *Innocent 7. Dream 
8. *Clever 8. *Honor 
9. *Afraid 9. Home ¥ 
10. Dream 10. *Steal 
11. *Bills 11. *Innocent 
12. *Thief 12. *Bills 
13. Home 13. Wish 
14. *Justice 14. *Hide 
15. *Steal 15. Girl 
16. *Purse 16. *Clever 
17. Girl 17. *Dresser 
18. Boy 18. *Silver 
19. Tree 19. *Purse 
20. *Dresser 20. Beautiful 
21. Beautiful 21. Dark 
22. *Silver 22. Boy 
23. Lock 23. Table 
24. Dark 24. Lock 
25. Table 25. Tree 









* Words picked beforehand as having here an especial emotional sig- 


nificance are marked with an asterisk. In the RT list these have an 


average rank of 18 per cent less than a chance ranking. In the PGR 
list these have an average rank of 22 per cent less than chance ranking, 
an increase of 4 per cent in this measure of diagnostic value over the 
RTranking. The rank method correlation between these is .60+ .086. 









stronger emotional disturbance. Those words in the two 
columns marked with an asterisk were selected beforehand as 
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likely to arouse the more intense emotions under the conditions 
involved in this study. It will be noted that the P.G.R. 
responses seem to be somewhat more diagnostic than the re- 


TABLE 4 


Total averages for the combined 2500 words in tenths of a 
second and hundredths of a milliampere 





REACTION TIME PSYCHOGALVANIC RESPONSE 





28.4 23.3 





EES 


Average responses for 625 words given in the morning and 1875 words given 
in the afternoon 
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Per cenis in morning and afternoon equalling or exceeding the total averages 
given above 

















REACTION TIME FI aa a nll 
per cent per cent 
SNL: 0 x‘ncdhbaMAOs «Robe oven bike bane tees vas 25.8 48.8 
a Ba sl ore ea Saeco Sees 28.4 38.9 
ON Siro rele is Pe AM ie sd cig inky nas 2.6 9.9 





Standard errors of difference of these differences computed from Edgerton 
and Paterson’s tables (2) 

















REACTION TIME P.G.R. 

ee ee. ee ea ae, 2.1 2.5 

aa 5s rie i i oa 1.2 4.5 
i action times. (See note with table 3.) The most extreme 
ia illustration of this is in the case of the word Thief. On the 


association time ranking this comes twelfth while on the P.G.R. 
ranking it comes first. We should expect this latter to be so. 
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Some of the other marked words are correspondingly moved 
upward in the second column. 

Particularly interesting is the location of the word Wish in 
the two lists. There seems to be some indication that the long 
reaction time which is characteristic of this word is due to some 
other cause than emotion, at least, insofar as the latter is meas- 
ured by the P.G.R. 

In the P.G.R. literature a stimulus word causing marked 
emotional disturbance has been reported to affect the post 
critical word. Our results thus far analyzed do not support this 
conclusion. Illustrating this the word Table in the stimulus 
list followed the word Thief yet there is little indication from 
the rankings that the location of the former word is materially 
affected by this. At the bottom of this data sheet is given the 
correlation by the rank method between the two measureé. 
The obtained rho is .60+ .086. Using Kelly’s table for error of 
estimate this has a predictability of 20 per cent better than 
chance. 

Table 4 gives first the total averages from the combined two 
thousand five hundred words for the two measures in the above 
units. Of the one hundred subjects tested twenty-five were 
tested in the morning between eight and twelve and the re- 
maining seventy-five in the afternoon between one-thirty and 
four-thirty. The averages for the six hundred twenty-five 
words given in the morning as compared with those for the 
eighteen hundred seventy-five given in the afternoon are also 
given. In order to obtain some measure of the significance of 
the differences in these our data were treated in the following 
manner. A count was taken of the total number of words 
given in the morning equalling or exceeding the total average 
and the per cent that this was of six hundred twenty-five was 
calculated. The same was done with the words given in 
the afternoon on the basis of eighteen hundred seventy-five. 
These per cents are given together with their differences in 
table 4. The standard errors of difference were now computed 
from Edgerton and Paterson’s tables. (2) These latter were 
now divided into the differences already obtained and show that 
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in each case the morning and afternoon variations are fairly 
reliable. The most reliable difference is found in the P.G.R. 
measures. This difference is four and three-tenths times the 
standard error of difference. These figures then give a fairly 
definite indication that: first, the reaction time is typically 
shorter in the morning, and second, that the P.G.R. reading is 
typically larger at this same time of day. 

We may sum up as follows: 

1. The Psychogalvanic apparatus seems to be a somewhat 
more diagnostic measure than reaction time when association 
words are used as stimuli to elicit emotional responses. 

2. As indicated by our findings the correlation between re- 
action time measures and P.G.R. readings may be expected 
to be in the neighborhood of .60 +.086. 

3. Reaction time seems to be typically shorter in the 
morning. 

4. The P.G.R. readings are strongly indicated to be larger 
in the morning than in the afternoon. 


SUMMARY AND SUGGESTIONS AS TO METHODS 


The foregoing experiments show with some certainty that 
our improved apparatus is capable of measuring more readily 
and clearly some of the aspects of affective behavior. The 
results are admittedly preliminary and are cited chiefly to show 
the applicability of this apparatus and the types of problems 
and methods of procedure to which it lends itself. 

Concerning the results on the problem here studied certain 
points may be quite definitely made. It is rather plainly in- 
dicated that this apparatus is somewhat more diagnostic than 
association reaction time. The diurnal variations in opposite 
direction of the reaction time and the P.G.R. measures are 
quite marked and definite. 

Farmer (3) and Chambers (4) have called attention to the 
fact that numerous errors enter into the measurement of the 
psychogalvanic response in addition to those in the apparatus 
thus making individual subject-to-subject comparison of almost 
no importance. 
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There are three possible legitimate methods that are prac- 
ticable at present. The first is the method of inter-comparison 
between the stimuli on each subject. This comparison might 
be in ratio form as in a comparison of the response to success 
with the same subjects’ response to failure (1). 

The second method is that of group investigation or compari- 
son of responses such as is used in the experiment with the associ- 
ation word list. The theory behind this is very simple. The 
additive and subtractive errors will in large part equalize 
each other. 

A third method has been used recently by Wechsler which 
is even more adapted to the present apparatus. In this records 
are made of the frequency of response to each stimulus. It 
seems to the writer that this holds most promise for quantitative 
comparison of stimuli. Large groups of subjects are used and 
the frequency of response is recorded without regard to the 
quantitative value of the single responses. Thus of two 
stimuli presented to the subjects that one bringing the most 
frequent response is taken as being the more significant. 

In any of these three methods of procedure much of the 
laborious “standardization of apparatus” which is often in- 
dulged in is not only unnecessary but is a waste of time. The 
only requirements would be of course that the same apparatus 
be used throughout one series of measurements and that that 
apparatus be held reasonably near the same sensitivity. 

One additional fact is of considerable importance. Even a 
casual study of the P.G.R. shows it to be very sensitive to the 
total stimulus situation. It would seem that the matter of 
first emphasis in studies of this type should be the isolation of 
stimuli. It is suggested that the general methods of Pavlov in 
controlling stimulus patterns (6) should be taken into con- 
sideration more seriously. 
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NEWS AND NOTES 


Exposition de Liege, 1930: During the year 1930 at Liege the people 
of Belgium will celebrate by means of an international exposition the 
century of their national independence. The plans provide a special 
place for the exhibit of diagrams, synoptic charts and tables, apparatus, 
teaching materials, tests, photographs and questionnaires relative to 
scientific organization, selection, placement and other personnel prob- 
lems of modern business, industry and education. Those interested in 
this most promising and interesting section should address Mr. Lucien 
Wellens, Secretaire de la Classe, 94 D, 11, rue de Seraing, Liege, Belgium. 


The Tenth Annual Ohio State Educational Conference: ‘‘Reaching 
the Individual’’ will be the keynote of the Tenth Annual Ohio State 
Educational Conference to be held in Columbus, April 3, 4, 5, 1930. Mr. 
Robert M. Hutchins, president of the University of Chicago, will speak 
at the Thursday night general session. Mr. E. H. Sothern, well-known 
actor and dramatic reader, will give a series of readings from Shakes- 
peare Friday night. One additional speaker for the Thursday night 
general session is yet to be secured. 

More than one hundred speakers, including some thirty-five from out 
of the state, will participate in the Tenth Annual Ohio State Educational 
Conference in which a registration of over five thousand is expected. 
Last year 5100 were registered. 

Visual education will be a new topic for which sectional meetings 
will be held. This brings the total number of sections to thirty-five. 
Three sessions of conference (Friday morning and afternoon and Satur- 
day morning) will be given over to these sectional conferences. 


Dr. J. E. W. Wallin, who for eight years was Director of the Bureau 
of Special Education and the Psycho-Educational Clinic and Professor 
of Clinical Psychology in Miami University, is now Director of the 
Division of Special Education in the Baltimore Department of Educa- 
tion which was established following a survey of special classes in 
Baltimore which he made last spring. Dr. Wallin also offers courses 
on the education and clinical study of handicapped children at Johns 
Hopkins University and Morgan College. He will offer similar courses 
in the first summer term at Johns Hopkins and in the second summer 
term at the University of Chicago. 
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J. L. Prax. De Psychotechniek der Beroepskeuze. J. B. Wolters’ 
U. M., Groningen, Den Haag, 1925. £4.50. 

This is a critical compilation work by a Dutch psychologist, who is in 
charge of the applied psychological work in the Philips Factories. 
There is very little that will prove to be new to the psychologist who is 
well acquainted with the literature on Employment Psychology and 
Vocational Selection. This book is however an excellent introduction 
into this field for the layman, or for the psychologist who is not in touch 
with this branch of his subject. It therefore serves the purpose the 
author set himself, viz.: to give a survey of the field and problems of 
the psychology of vocational and personnel selection; to demonstrate, 
with proofs gathered from the investigations of many authors, the 
value of experimental research methods and precise statistical methods 
of calculation in connection with such selection; and to warn against 
the too optimistic belief in so-called intuitive knowledge of mankind. 
The author draws very heavily from many sources and the Bibliography 
succeeding each chapter contains references to Dutch, French, English, 
American and German works. The latter may prove useful to those 
being introduced to the subject but contains nothing unknown to the 
worker in the field. A brief summary of the contents will show to what 
extent the book is a compilation. 

In Chapter 1 the factors which at present influence the choice of an 
occupation are described in the usual way and the ordinary methods of 
selecting a job are criticised. Opinions of well-known people and 
American data on labour turnover are given. Chapter 2 contains a 
discussion of the reasons for their choice of an occupation given by 
schoolboys and students according to the investigations of Minkus, 
Jonckheere, Fischer and especially of Wisse whose work carried out in 
Holland is cited at some length to show that the student does not choose 
a profession but a subject for study, and that ultimately the issue is 
decided not by the demands of the profession or the qualities of the 
individual but by financial attractiveness of the position, family tradi- 
tion, etc. Hollingworth is cited at length in the discussion of the value of 
self-estimates, and also, together with Rugg and the Army Rating Scale, 
in connection with the value of the rating of characteristics by others. 
Roloff’s results on the value of teachers’ judgments of their schoel- 
children’s intelligence are also given. The value of school attainments 
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as an indication of vocational aptitude is discussed in connection with 
the results of Kelley, Miles, Dearborn, Smith and Thorndike. Holling- 
worth is also the chief source from which the material for Chapter 3 is 
drawn which contains a criticism of the usual methods for choosing 
personnel. In connection with the value of letters of application 
Poffenberger and Vartanian are also cited, in connection with the value 
of photographs also Pintner, Anderson, Cleaton and Knight, and in con- 
nection with the personal interview also Binet, Scott and Snow. Chap- 
ter 4 contains an extremely brief sketch of the development and subject- 
matter of Psychology, and Chapter 5 a short survey of the procedure in 
Vocational and Employment Psychology. In Chapter 6 the following 
are described at some length as a few of the chief events in its history: 
Minsterberg’s work and experiments, the Binet-Simon tests, the Ameri- 
can Army tests, Moede and Piorkowski’s tests for the Begabtenschule 
in Berlin, and Stern’s Hamburg tests for a similar purpose. Chapter 7 
chiefly contains illustrations of investigations of several kinds of occupa- 
tions, e.g., Tramm’s of Tram-drivers; that of the German Railway’s 
investigation Bureau of apprentices in the workshops; that of Giese, as 
well as that of Brugmans and Prak, of Exchange Girls; Cyril Burt's 
of Stenographers; and Schulte’s of the Ladies’ Hairdresser. In Chapter 
8 the present position of Vocational Psychology in the different coun- 
tries is described, especially in the Netherlands. Objections against 
this branch of science are stated and discussed in Chapter 9; and in 
Chapter 10 the author criticises very sharply the standpoint of those 
who favour the use of various types of questionnaires instead of experi- 
mental investigations in connection with the problems of selection. 
Chapter 11 is an elementary one on the statistical methods used, and in 
Chapter 12 the education of the practical psychologist is briefly dis- 
cussed in connection with a diploma course of London University, and 
the different types of institutions in which Psychotechnic is developing 
are mentioned. 

The book is, however, not just a compilation but critical throughout 
and reveals the author’s scientific attitude and practical experience. 
There is no over-enthusiasm but the exposition of facts in a sound and 
sensiblemanner. This makes it all the more valuable as an introductory 
work, especially as the attempt has evidently been made to be as clear 
as possible by just presenting the generally accepted outline of what is 
and can be done, and not entering to any extent upon difficulties which 
still perplex the specialist. The fact must nevertheless be recognized 
that even in the critical remarks on the whole the initiated will find 
nothing very striking or new, so that one does not feel that anything 
has been added to one’s usual point of view. An exception is formed by 
Chapter 10 and anyone interested in making use of questionnaires in 
connection with Vocational Selection or Employment Psychology, or 
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wishing to obtain answers from teachers to lists of questions on the 
characteristics of their scholars for some other purpose, would do well 
to read this chapter. 
H. F. Verworrp, 
University of Stellenbosch. 


Gast AND SKINNER. Fundamentals of Educational Psychology. Benj. 
H. Sanborn Co., New York City, 1929. 354 pp. 

The authors have departed from the usual text in educational psy- 
chology in several ways. One of the improvements is the inclusion of a 
chapter on childhood and adolescence. In this chapter they discuss 
problems of growth and development which are usually excluded from 
educational psychologies. Criticisms of this chapter are undoubtedly 
due because of its brevity and lack of data, but the authors do deserve 
commendation for including it at all. 

Two other departures are somewhat interesting. One is the inclusion 
of about two score pictures of psychologists and educators—many of 
them living. Much is made of psychological authorities, and the book 
bristles with ‘“Thorndike says, Burt states, Burnham reminds us,’’ etc. 
It seems to the reviewer that the student is apt to become a worshipper 
of authority instead of a critical thinker dealing with data. Another 
departure from the usual text was the failure to make any attempt to 
provide a logical system of educational psychology. What advantage 
there can be in an unsystematic treatment the reviewer fails to see. 
Certainly the laws of learning and retention make it clear that well 
organized material will be retained more easily and longer—but perhaps 
a psychologist is not expected to observe the laws of learning. 

Sruart M. Sroxs, 
Ohio University. 


Epmunp S. Conxurn. The Psychology of Religious Adjustment. The 
Macmillan Company, New York, 1929. Pp. xiv + 340. 

As the title suggests the author thinks of religion as a method of 
adjustment. He makes a good case for this particular way of regarding 
it without letting his thesis so influence his material and treatment as to 
greatly impair the value of his work for those who regard religion in 
some other way: as divine revelation, infantile regression, or what not. 
This concept does, however, color the author’s explanations of certain 
religious phenomena and it is in these explanations that most of the 
originality the work may possess is to be found. 

It may not be amiss to point out a few features of the book which 
seem especially commendable. Many students of the psychology of 
religion fall short of the scientific ideal in that they are either friends or 
enemies of religion and clearly show the effect of their attitudes in their 
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writing. In the opinion of the reviewer the author has avoided this 
error to a greater degree than have the majority of writers in this field. 
It is also to be noted that the psychology of conversion is given a less 
prominent place than it has traditionally held, being discussed ade- 
quately in one chapter of medium length. This is especially com- 
mendable in view of the decreasing emphasis on conversion in many 
religious sects. Ecstatic states including ‘“‘power states,’’ prophecy and 
mysticism are treated in two chapters, and religious exercises in three. 
Much of the value of the book consists in the treatment of certain 
phenomena often neglected. Sanctification, the retreat, speaking with 
tongues, and apocalypticism may be mentioned as examples. 

The author has little sympathy for the emphasis often placed on the 
sex element. That the love of God is derived from the primitive sex 
instinct, that mysticism may be traceable to sexual abnormalities he 
refutes. For McDougall’s love sentiment he finds a place; for the 
interpretation of the Freudians, none. 

Amos C. ANDERSON 
Ohio University 
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NEW BOOKS AND PAMPHLETS* 


Books and pamphlets for review should be sent to James P. Porter, 

Department of Psychology, Ohio University, Athens, Ohio. 

American Hand Writing Scale. Paut V. West. The A. N. Palmer 
Company, New York City. 

Characteristic Differences of Good and Poor Teachers. A. 8. Barr. 
Public School Publishing Company, Bloomington, Ill. 127 pp. 

Conquest of Thought by Invention, The. H.Srarrornp Hatrietp. W. W. 
Norton & Company. $1.00. 80 pp. 

Crime and the Press. Joserpa L. Hotmes. From Journal of Criminal 
Law and Criminology, Vol. XX, Nos. 1&2. 1929. 107 pp. 

Diagnostic and Remedial Work in Arithmetic Fundamentals. May 
Lazar. Board of Education, New York City. Bureau of Refer- 
ences, Research and Statistics. 204 pp. 

Ethics. Frank C. Suarp. The Century Company, New York City. 
$3.50. 

Foundations of Experimental Psychology, The. Cart MuRcHISON, 
Editor, and twenty-three contributing authors. Clark University 
Press, Worcester, Mass. 1929. $4.00. 907 pp. 

Fundamentals of Educational Psychology. Ira Morris Gast AND 
Haruey Ciay Skinner. Benjamin H. Sanborn & Company, New 
York City. 354 pp. 

Future of the Earth, The. Haroup Jerrrers. W. W. Norton & Com- 
pany. $1.00. 79 pp. 

How to Find the Right Vocation. Harry Dexter Kitson. Harper & 
Brothers, New York City. $2.50. 202 pp. 

Introduction to Abnormal Psychology. V.E.¥Fisuer. Macmillan Com- 
pany, New York City. 512 pp. 

Just Normal Children. Fiorence Mateer. D. Appleton & Company. 
$2.00. 294 pp. 

Musician’s Arithmetic, The. Max F. Meyer. University of Missouri 
Studies, Vol. IV, No. 1, Columbia, Mo. 149 pp. 

Measurement of Attitude, The. L. L. Taurstone anv E. J. Cuave. 
University of Chicago Press, Chicago, Ill. $1.00. 96 pp. 

Mind at Mischief, The. Wiut1am 8. Sapter. Funk & Wagnalls Com- 
pany, New York City. $4.00. 400 pp. 





* Mention here does not preclude further comment. 
652 














| 


NEW BOOKS AND PAMPHLETS 653 


Newer Ways with Children. M. V. O’SHea. Greenberg, Publisher, 
New York City. 419 pp. 

An Outline of Social Psychology. J. R. Kantor. Follett Publishing 
Company, Chicago, Ill. 420 pp. 

Practical Salesmanship. W.L. Barnuart. The Ronald Press Com- 
pany, New York City. $3.50. 266 pp. 

Psychological Register, The. Cart MuRcHISON AND oTHERS. Clark 
University Press, Worcester, Mass. $6.00. 580 pp. 

Psychology of Adolescence, The. Fowter D. Brooks. Houghton 
Mifflin Company. 652 pp. 

Psychology. Revised Edition. Rosert S. Woopworts. Henry Holt 
& Company, New York City. $3.00. 590 pp. 

Relative Frequency as a Determinant of Phonetic Change. GrorcE 
Kinestzey Zier. From Harvard Studies in Classical Philology, 
Vol. XL, 1929. 95 pp. 

Science of Psychology. Raymonp Hotper Waueeter. Thomas Y. 
Crowell, New York City. $3.75. 556 pp. 

Social Psychology. Bernarp C. Ewer. Macmillan Company, New 
York City. 436 pp. 

Social Psychology of International Conduct. George Matcoim Srrat- 
ton. D. Appleton Company, New York City. $3.00. 387 pp. 
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